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Pause Analysis as a Short Interviewing Technique 
Walter Toman 


Harvard University 


The basic rule for the patient in psychoan- 
alytic treatment is to say everything that comes 
to his mind, without selection [1, p. 23; 2, p. 
192]. He is to associate freely, and whenever 
he stops, whenever he makes a pause, the psy- 
choanalyst is, in principle, permitted to prod 
the patient. Thus the pauses the patient makes 
become specific points of interaction, and it 
seems quite possible that some of the peculiar- 
ity of psychoanalytic treatment when compared 
to any other form of psychotherapy springs 
from this procedure. 


In prodding the patient to express what 
went on in his mind during the pause, or what 
idea interfered and made him stop, the analyst 
risks diverting the patient from the ongoing 
trend of free association, and at times it might 
be more important, therapeutically, to prod the 
patient to go on. At times the interruption by 
the analyst may be quite welcome to the 
patient, and the welcome topics are not al- 
ways the ones psychoanalysis is after. In addi- 
tion we should realize that it is when the 
patient pauses, that interpretations by the 
analyst or even questions leading up to inter- 
pretations are made. Seldom is such a question 
raised or an interpretation started by the ther- 
apist while the patient is still talking. Thus 
with a question referring to anything but the 
pause, we miss the pause, and with any ques- 
tion referring to the pause, we might miss 
further associations. It takes considerable skill 
to handle these intricate “molecular” inter- 
actions occurring in psychoanalysis, and this 
skill, in turn, requires training and experience, 
and experience and training, ad infinitum. 

In 1950 H. Rohracher of the University of 
Vienna suggested an explanation of pauses in 
speech. While Johanna Karger started work- 
ing on the quantitative and classificatory analy- 
sis of pauses in reading and speaking [3], I 
began to labor on the dynamic aspects. The 


reasoning given above was the starting point. 
Before I describe my proceedings, I would like 
to give a brief account of Karger’s findings. 


Twelve subjects had to read a short text aloud. 
They were sound-recorded and the pauses were ex- 
plained afterwards by the subjects. Ninety-three per 
cent of the pauses were connected with punctuation 
marks, the rest with disturbances of task-aware- 
ness, distraction of attention, difficulties in apper- 
ception and conflicts between punctuation marks 
and personal organization of the text. The longest 
pauses varied between 0.5 and 1 second, and never 
exceeded 1.8 seconds. In free speech as contrasted 
with reading (instruction: “Explain why you chose 
your field of study or your particular profession.”’) 
the longest pauses exceeded 1.8 seconds with every 
subject. It was found that the faster the subject 
speaks, the greater the relative and the absolute 
average length of his or her pauses. The ratio of 
pauses made at all and pauses which the subjects 
recognized as pauses and explained was 6:1. The 
estimate of number of pauses made at all was based 
on the minimal time interval between two spoken 
words that a keen observer would just begin to 
consider a pause. This estimate depended on the 
rigor of the observer, and my ratio of 54.7:17 re- 
ported below does not contradict the former ratio. 
It only indicates a different standard as to what 
might possibly be considered a pause, and this 
standard is not crucial for my experiment. The 
causes of pauses in free speech were: (a) disturb- 
ances of composition, (4) distractions of attention, 
(¢) disturbances in production of ideas, (d) pauses 
due to ordering the material, (¢) time-consuming 
will processes, (f) disturbances in verbal expres- 
sion (breathing, fatigue, slips of the tongue, etc.). 
No further specifications were attempted by J. Kar- 
ger. 


The Experiment 


My experiment called for a life history of 
5 to 10 minutes length, to be spoken by the 
subject into the microphone of a sound record- 
er. The subjects were given a casual half- 
minute of preparation, during which the ex- 
perimenter got the sound recorder ready, or 
pretended to do so. Then the subjects spoke 
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their life history into the microphone. They 
were asked to take about 5 to 10 minutes, and 
to make it not too factual. The experimenter 
was present but did not interfere, not even by 
nodding or by any changes in facial expression. 


After the life history was completed, the ex- 
perimenter and the subject went over the 
record and analyzed the pauses. Only then did 
the subjects learn that the pauses were the 
object of investigation. About three-fourths of 
the subjects were surprised by the fact that 
apparently so much had gone on “between the 
lines” of their performance that otherwise 
would have escaped their notice. 


Results 


All of 35 subjects ranging from 18 to 34 
years (13 male and 8 female students, 6 male 
and 3 female adults in nonacademic profess- 
ions, and 3 male and 2 female adults in aca- 
demic professions) revealed content material 
hidden or suppressed in the pauses that proba- 
bly could not have been brought to light by 
other interviewing procedures in the given 
time, i. e., 5 to 10 minutes talking and 10 to 
30 minutes of analyzing the pauses of the 
monologue. Subsequent to the test an interview 
was conducted with every subject in order to 
enable the experimenter to further appraise 
the significance of the content filled into the 
pauses by the subject while going over the 
record with the experimenter. A few examples 
of the performance will be given below. 

The subjects produced life histories of an 
average length of 675 words, with a standard 
deviation of 230 words. They made an 
average of 54.4 pauses (with a standard devi- 
ation of 26), of which 17 pauses on the 
average (with a standard deviation of 9.2) 
could be interpreted by the subjects other than 
by mere formal difficulties of phrasing or 
searching for appropriate words. 

In order to obtain some sort of an objective 
measure for the significance of the content 
material given by the subjects when inter- 
preting their pauses, they were unexpectedly 
asked to come for another svssion 1 to 3 
months later. Then they were exposed to their 
records again and asked to interpret the pauses 
again as far as they could still remember them. 
On the average 5.3 pauses were recalled (with 
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a standard deviation of 2.7). The content of 
the other pauses had been forgotten. It turned 
out that 2.8 of the recalled pauses, i.e., of the 
recalled ideas or images or thoughts that had 
originally interfered with the delivery of their 
life history, were apparently affect-laden early 
memories, even very early childhood memo- 
ries, that had oddly popped into the subjects’ 
minds while speaking into the microphone. 
The rest were recent memories concerning the 
subjects’ present activities and occupations, 
recent personal relationships and thoughts per- 
taining to the performance of the test. 


These latter memories were presumably not 
too difficult to recall nor even to reconstruct 
from the context; but the earlier memories 
that would appear out of context of the de- 
livered life history to anyone but the subject 
himself or a sophisticated psychologist would 
have been impossible to recall unless the same 
dynamic factor that had originally brought 
them up had been reactivated. These memories 
seem to stand for stronger (older and possibly 
unconscious) dynamic constellations. We may 
conclude that they were significant, important 
memories, otherwise the subject would not 
have recalled them on the right spot in the 
objectively inconspicuous context of his de- 
livered life history. In that sense this check 
may be considered an objective measure for 
the significance of the content material given 
by the subjects when interpreting their pauses. 

Four examples of records interpreted 
immediately after the test are given below. 
All further references and comments to the 
cases have been omitted. They will serve only 
as a demonstration of the test performance in- 
cluding the interpreted pauses. Thoughts 
going on during the pauses and reported by 
the subjects while going over the sound record 
with the experimenter are underlined. 


Examples 
Subject A (male, 20 years old) 


I remember very little of the first few years. 
Just that I was born in K. and moved immediately 
to D. where I lived until I was about 5 years old. 
I had a very. . . a little scene in kindergarden. A 
little girl was crying lustily when having to stay 
there. I cried too. We made quite a scene... 
strong, childish attraction for a little blonde girl 
there, and we have kept writing ever since, and 
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she came to K. last, last month, which was the 
first date I have had for, during my college ex- 
perience. This particularly bothers me. Anyway, 
then we moved to E. I went to the local grammar 
school, very . . . out in the country, worsi teachers, 
poor reputation. Father worked to set up schools. 
Had many enemies. Mother has practically gone 
blind (over all this). She is very introverted and 
sensitive . . . poor grammar school, actually, and 
there I had three good boy friends, and one pretty 
blonde girl again with whom I spent a number... 
her older brother got between us. Had a tent. 
Wanted his sister and me to undress and play with 
each other. I never liked the fellow .. . of the first 
few years. I can remember that I used to be ter- 
rifically sensitive in grammar school, particularly 
about playing sports. I was very slow on my feet. 
I could not run in the right way. I used to run on 
my toes instead of on my feet. So the others would 
goad me into playing tag with them, practically 
every day during the first 6 years of grammar 
school, it seems, anyway. And I would get... J 
got very hurt and nervous. My best friends were 
wery callous. Were best friends, and stabbed you 
in the next minute. I was worried about other 
people’s opinion about me... .1 tried not to show 
my anger and, but it did affect me very much. I 
was very easily offended and hurt. I rermember one 
time that one boy who was actually my best friend 
made a nasty remark, and I had to stay home that 


afternoon, because I could not. . .. I lowered my- 
self by offering him a bicycle ride home. Felt dis- 
gusted with myself . . . face going back to school 


again. Then going to high school I did very well 
in school. I was number one student in town grad- 
uating to high school and so I had a very easy 
time. My brother went to high school the year be- 
fore, and he made such a terrifically good impres- 
sion that I got by on his own scholastic ability, that 
is, they gave me all A’s without really knowing. 
... TI felt inferior to my brother. But then I became 
the first in town. My brother had left town . 

what my own talents were. Although I don’t know 
whether I would have gotten A’s or not. Probably 
yes. But I never had a date with a girl during 
high school and this particularly bothered me. I 
never learned to dance, and I felt that was one of 
the most unfortunate parts of it... . My parents 
should have encouraged me. They let me down. 
Brought me up in the wrong way. Later on I 
talked it over with my father. He said: “We never 
stopped you.” But I had the impression, they did 
not approve. . . . My parents during this time 
never encouraged me or inhibited me from going 
with girls, but I never had the courage to do it 
myself, and it has carried over until now, practi- 
cally. I suppose this is the most interesting part of 
what I am supposed to say. I don’t know. And 
then I wanted to get on the football team in high 
school, but never did actually try out for it. Per- 
haps I could have made it. Then during my jun- 


ior year of high school my parents decided they 
wanted me to go to A. for my senior year, and so 
I had to work very, very hard then in order to 
make the scholastic standing necessary to get into 
A. I did get into A. with full scholarship and felt 
pretty good about my own capabilities then. But 
when I got there I found that in the first term in A. 
I got a C minus-and-a-half average, which was 
very, very poor, particularly for a scholarship boy, 
so after that I became a recluse and spent about all 
of my time studying . . . there were dances in A., 
Saturday nights. I wanted to go, but did not. 
Used to sit in my room ... so that I had no social 
life to speak of at A. I never joined a club or any- 
thing. I just stayed in my room and ground away. 
Then I... .My brother was in college. I was just 
going to follow him. I was not very ambitious to go. 
I just as soon would have worked . .. did not give 
much thought to college. I did not really expect I 
would be able to go to college, because of financial 
reasons, but I half-heartedly applied, took the col- 
lege entrance exams, and U. admitted me. It was 
the only college I had applied to. And. . . they 
should have (awarded me a scholarship). I had 
good records, eventually. A. did not elect me for 
the cum laude society. They slighted me. They sent 
me to Washington, free, for a week, though. My 
brother had been elected. . . they did not award me 
a scholarship, though. The only way I came here 
was that A. managed, A. did give me a prize 
scholarship, $400, and also the X.Y. Association 
gave me a scholarship. And also a very old lady 
who just died gave me a gift of $2500 for my 
school, my college career, which I could not have 
done without, and I did finally get to U. 

money stretched over 4 years made things easier, 
but still pretty hard. ... And during my freshman 
year in U. I roomed with a Jewish boy who was 
about as introverted as I was, and I found myself 
not particularly liking him, but pitying him in a 
way. ... in French class two girls were sitting 
next to us, but we never approached them 

and we became rather good friends. It was a rath 
er artificial friendship, since I . . . this amounts 
to saying, I am superior. His father (who had in- 
vented something and discussed advertising it with 
his son) said: “We put a nice nude on it.” The 
boy had some nasty habits, was dirty, aleways pick- 
ing his nose . . . pitying him, as I did, it was a 
rather superior feeling I had towards him. Never- 
theless we did become very good friends. We, we 
both wanted to go out with V. girls, but we never 
managed it. I managed to rationalize myself into 
thinking that it was because of my low finances, 
and that’s partly true, I suppose .. . it was in me, 
of course . . . but the result was what I figured a 
rather poor sexual adjustment. And being a senior 
now this has carried over. And I have had one 
date in my life time, so to speak, that is a couple 
during ... my and her parents were along. She 
was older than I was . .. during the summer 
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times, picnics and that sort of things, but I find it 
very, very difficult to approach girls in a... . TI 
am getting all worked up. This problem is a con- 
temporary one... in a way that’s not self-con- 
scious. 


Subject B (female, 19 years old) 


I was born in N., and I can’t remember anything 
until I was about 3 years old ... memory of the 
house we used to live in: picture of my uncle stand- 
ing in the toilet; father said: “He is taking a pic- 
ture. Come on!” . . . and I can rermember being a 
happy child. I think I got a lot of attention. ... TJ 
was over-protected, I guess ... from my parents 
when I was very young. And I had a lot of suc- 
cess in school, and even in kindergarden I remem- 
ber 1 was the best reader... from when on was I 
a lucky child? What facts do I have? ... and I 
could draw and paint... . this is not enough. What 
did I do at home? Can’t find anything . . . and all 
that sort of thing. And I went to elementary school. 
In about the third grade, I suppose, I was, oh, 9 
years old, I had a little trouble with the children 
in my class. I was much more withdrawn. I was 
more imaginative, introverted than they were. I 
would not really understand the more social gang- 
like times that they had... . J felt left out. I used 
to cry. Mother was so helpful. She handled me so 
good ... and I felt left out. I felt very unhappy. 
I remember they used to make fun of me. And I 
was always the kind of kid that used to go by 
herself and, oh . . . fairies, later on love, also na- 
ture, lose myself in those things. Reading and writ- 
ing poems. Thoughts like: How do you feel the 
infinite? What happens if you fall forewer? .. . 
imagine things a lot. Oh, I wrote poetry starting 
from when I was 6 years old, I think. And I went 
to ... much earlier than high school I became a 
social being. I left out girls, got along very well 
with boys, was never in a gang. The girls used 
lipstick, they were teen-agy quite early ... a very, 
very fine high school in N. I always had a lot of 
academic success, and in spite of this early with- 
drawnness of mine, I guess, I was fairly popular, 
and in high school I majored in art, and I became 
interested in dancing and music and all these other 
things, and I had a wonderful time, a lot of social 
success, academic success. I became good in many, 
many things, and I really, really enjoyed school 
aaa... so much to tell. People were so congenial, 
liberated, very alive and lively atmosphere, good 
relationships with teachers...a great deal. As far 
as my home life went at that time, I think, start- 
ing around, oh, 15, I began. .. . J wanted to probe 
everything. Not deny any experience. Look for the 
truth. .. . I began to rebel quite strongly against 
my family, because I did not think that what they 
demanded from me was what I wanted to fulfill. 
And I feel now, that they were very, very. . . there 
was a fight. I did a lot of square dancing. Wanted 
to go with a Negro boy. They forbid it, but I did 


it. There was hell in the house .. . oh, they ex- 
pected a lot in the way of nominal achievement 
and following what their goals were, I think, much 
too much. And starting at 16 I began to rebel. I 
became critical of American culture. I think, yes, 
and this was also the same time when I thought I 
was discovering that I was popular and that I had 
a nice personality, and that the boys liked me, and 
that sort of thing. And. . . nowadays I dislike my 
adolescence. So much dishonesty in that age, effort 
to make impression, feminine wiles. Disgusting .. . 
this went to my head for a little while, and after 
that I became, as I said, critical and went to the 
other extreme. I joined a, aaa... how should I 
characterize it, express the spirit? . . . youth Zion- 
ist group which was very, very, very revolutionary 
in its mores and, oh, no lipstick and girls treated 
completely equal with men. ... These were the 
goals, but they did not really achieve them. Girls 
became masculine. No positive culture of their own 

. oh, really a little community within itself, and 
Marxist orientation . . . they were not even good 
Marxists . . . and tried very hard to establish hon- 
esty and introspection, and complete naturalness 
. .. Some of the girls opposed integration, thought 
Zionism is the solution, guite doctrinaire . .. I 
guess, as goals. And oh, when I came to C. as a 
freshman, I was just, just coming out of this. .. . 
Girls in C. less accepting than in N., pressure to- 
ward conformity; it was hard to accept them as 
people. I had a real war for a year. ...1 was 
always somewhat critical, and yet I found things 
there I felt, and still feel, . . . competition, selfish- 
ness, sterility of the whole culture ... are lacking 
in American culture. And I became very interested 
in Judaism as a way of life, and politically a Zion- 
ist, and, well. ... Oh, I am up to the present... 
at this point I no longer am a political Zionist. 
I am very interested in Judaism. I am interested in 
modern dancing. I do more of that, practically, 
than anything else. I have made a conscious effort 
to narrow down my .. . talents? That's conceited 
. + « fields of expression and chosen dancing as the 
one I more or less concentrate on. I hope after col- 
lege. . . well, I don’t really know. It’s all vague 

. somehow, oh yes, I have always been interested 
in. ... J] left out my settlement experiences. Do I 
really have abilities in therapy? . . . therapy and 
helping people. I did a lot of work in settlement 
camps during the summers with a group of kids. 
I like to teach very much. I enjoy working with 
children, and I would like to combine therapy with 
dancing. And possibly go to Israel after college. I 
guess that’s about all. 


Subject C (male, 27 years old) 


. . « Shall I tell him my mother was psychotic, 
or not? .... Well, I think, one of the things that’s 
important in my life history is the... . J am going 
to tell him that, but I start somewhere else . . . is 
the, oh, type of place of my childhood. I grew up 
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in a very small town in the West, in a culture quite 
different from the one that I am in now... . I 
felt better in childhood than now. Is that neurotic? 

. aaa, life there is quite in contrast to the one 
life one leads around here. It’s a rather quiet, free 
and easy sort of existence, whereas everything 
here seems to me to be very hostile, full of pres- 
sure, aaa... . What shall I say mext? .. . to ac- 
complish things all the time. I find considerable 
lack of time to sit back and relax and sort of give 
in. ... I better not get emotional . . . to the enjoy- 
ment of . . . existence? living? that’s a poor sen- 
tence . . . my existence. Aaa, another very im- 
portant thing in my life are my parents, aaa. . 
Whom shall I take first? .. . . My father was a 
very quiet ... image of him . . . retiring sort of 
person, very, very conscientious, working extremely 
hard, and not very ... (some thought that sub- 
ject could mot recall) .. . had not very much to 
say when he was at home. Seems to me, he was a 
sort of a shadowy background figure in the house- 
hold rather . . . but he was warm, even though ret- 
icent . .. than a dominant person. My mother . 
her father very stern, militaristic, had a lot of con- 
trol, her affective needs starved .. . grew up on a 
farm in the West, had, I think, a rather hard 
childhood herself that carried over to her later life, 
and ... unfortunately, although I should not say 
so... to my life. I think, she tried. .. . I better 
try to understand . . . overly hard to compensate 
for some of the things that she missed in her child- 
hood, and as the result of that she tried too hard to 
make things easy for myself and for my brother 

. image of myself as a child of 6 or 8... tried 
too hard to . . . control . . . protect us from the 
vicissitudes of life, rather had a certain, had a 
negative effect on my life. I think I lack a lot of 

. image of a very energetic, goal-directed per- 
son (male) ... drive and autonomy that I might 
otherwise have had .. . some sort of therapy might 
help, I hope . . . aaa. I think, probably the most 
significant thing in my life that I can think about, 
if I were to point to a single incidence, was the 
psychotic break that my mother had when she was 
about etc. 


Subject D (female, 21 years old) 


The first thing I remember is wanting to go to 
school and starting a little early, and liking it 
very much . . . picture of myself, over-confident, 
boastful . . . and all during grammar school I was 
pretty sure of myself and liked it. And when the 
first ... my father did not want me to go to school. 
My sister went. It was too hard. I was not strong 
enough, they said . . . conflict came, when it be- 
came time to choose a high school; I chose one that 
was strictly college preparatory, to which girls from 
all over R. went, as opposed to a local high school. 
And as soon as I started that I lost confidence . . . 
picture of myself. What would it be to others, 
when I make new friends? . . . felt more pressure 


upon me. I had to work harder, was not sure of 
myself as far as making friends went, and although 
I liked school very much, I disliked the teachers, 
the pressure I felt from them... . (After 10 sec- 
onds) I hate not to be able to say anything (fur- 
ther 20 seconds elapse). . . . It was an all girls’ 
school which was nice from the point of view of 
having girl friends, though we were always quite 
shy about meeting with boys and did not like to 
go for that reason. And the school put a lot of 
pressure on it, towards choosing a good college, 
towards making us want to go, but never gave us 
a chance to decide whether or not we wanted to go. 
It just assumed that we would. And upon going to 
college I have never again felt as much pressure 
as I did in high school and was glad to go to a col- 
lege that is at least partially coed. I also felt that 
the situation was a lot more natural. 


Discussion 


There seem to be certain advantages to this 
technique. One of them is the following: The 
subjects tend to organize their thoughts as well 
as possible and to give a somewhat coherent 
story. The fact that their performance is 
sound-recorded increases their concern with 
the quality of their performance. On the other 
hand, they are not given sufficient time to or- 
ganize their story in advance. Rather they are 
caught by the sound recorder in the process of 
organizing, and in this sense the technique may 
be called a situational test. All criteria de- 
veloped for appraising verbal creations are 
eligible and may be applied. 

The effort of organizing the story for the 
sound recorder is presumably greater than the 
effort of organizing-it for a listener in a more 
familiar situation like interviewing, or coun- 
seling, or any conversation. A little speculation 
may be inserted here, that has been confirmed 
on other grounds by the author. If we assume 
that a higher effort put into the performance 
would consume more “psychic energy,” we 
would expect less energy to be available for 
any concurrent activities. The main concurrent 
activity in the delivery of one’s life history 
consists of the defenses against making slips, 
against revealing too much or uncovering one’s 
emotions more than intended. We would pre- 
dict that the greater effort may either lower 
the effectiveness of the defenses against un- 
wanted impulses or, if this is not the case, the 
defense mechanisms themselves may become 
more apparent. Both types of effects may give 
the counselor or therapist cues about the sub- 





6 Walter 


ject that he might not be able to secure other- 
wise, at least not in the given time or not 
simultaneously with a life history of the sub- 
ject. Examples of the first type have been given 
(subjects A, B, C). Examples of the second 
type are a few meagre life histories among my 
records, with long pauses and frequent blanks 
with respect to the pauses (subject D). These 
subjects reported that realizing that they 
made pauses extended one or the other pause 
to an unusual length, and this in turn blocked 
their performance, and caused further pauses, 
until they eventually gave up. 

Another advantage becomes clear when we 
compare this technique with psychoanalytic 
therapy in particular, but also with any coun- 
seling or interviewing technique. As pointed 
out in the beginning, the pauses are crucial 
events in psychoanalytic treatment, and how- 
ever the therapist deals with a single pause, 
he is interfering. The reported technique yields 
a record of the uninterrupted cognitive pro- 
cesses of 5 to 10 minutes in length, a sufficient 
time for a fruitful systematic analysis of the 
meaning of the pauses. 


A third advantage becomes apparent when 
the record is reviewed. The subjects are 
surprised by what they said, even surprised by 
their voice, if they have not heard it recorded 
before, and this surprise contributes strongly 
to their willingness to cooperate in the analysis 
of their pauses. They feel encouraged to take 
a more objective attitude toward what they 
said into the microphone than they do when 
reference is made to what they said in an 
ordinary interview or conversation with no 
recording. All subjects except the few who had 
given very meagre life histories with extreme- 
ly long pauses were willing to talk very frank- 
ly and openly about themselves and their lives, 
but even the defensive subjects were willing 
to talk at least about their inhibitions and 
defenses and found some relief in so doing. 
Subject and experimenter (client and thera- 
pist) are both dealing with the record of the 
subject’s past performance, and this may 
account for the objective attitude the subject 
is able to assume quite easily. According to an 
accepted psychoanalytic metaphor one part of 
the ego has to cooperate with the analyst in 
getting a hold on the unconscious parts of the 


Toman 


ego (and on the other systems). The pause- 
analysis technique facilitates this cooperation. 
The subjects slide into a good contact and 
rapport with the counselor or therapist, while 
talking about their performance, their pauses, 
and even their defenses. 

A fourth advantage is the possibility of 
going over the subject’s performance at any 
later time. What pauses are recalled that have 
been interpreted (given content and meaning) 
by the subject in the first session may give 
additional cues (see “Results” above). Fur- 
thermore, the attitude of the subject to his 
now quite remote performance can be appraised 
and utilized in several clinical aspects. 

Do the subjects manage to interpret all the 
pauses they make? I would say, they manage 
to interpret all the pauses that are important 
as to contents and dynamics. Of 54.4 pauses 
on the average counted by the experimenter, 
17 pauses on the average were commented on 
and interpreted by the subjects. All the other 
pauses could safely be considered as pauses due 
to formal difficulties, difficulties of finding the 
appropriate words or of finishing a sentence. 
The subjects were asked to tell what went on 
during the pauses while hearing their records, 
and in the beginning the experimenter stopped 
the record at whatever he considered a pause, 
but soon the subjects began to cooperate quite 
efficiently by telling when to stop the record 
and when not to stop it. Among other reasons, 
this could be relied on since the subjects had 
been told that they could refuse to talk about 
things they did not want to confide. In this 
case they had only to indicate that there were 
such things. However, very few subjects re- 
sorted to that privilege. 

Can we believe what the subject reports? 
This question may be raised just as well with 
any psychological approach to personality, and 
particularly with any form of interviewing. 
On the grounds mentioned above (good 
rapport with experimenter, increased objective 
interest, etc.) we may expect more reliable 
reports from the subject with the pause-analy- 
sis technique than with other short interview- 
ing techniques. 

Why apply the analysis of pauses to life 
histories and not, say, to TAT stories? There 
is no reason why one should not also apply 
it successfully to TAT stories. But the life 
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history of a subject is probably the most 
crucial and important of all the stories he can 
tell. Any therapeutic effect can, in some sense, 
be viewed as a recentering, a revision of the 
life history of the subject, and it is not the 
events that are revised, but their evaluation. 
The disappearance of neurotic symptoms is 
only a secondary effect. Life histories, verbal 
or written, given by the patients before and 
after treatment may in general be the most 
valuable and easy-to-obtain, although certainly 
imperfect objective checks on these revised 
evaluations, on a changed self concept, on a 
liberated and strengthened ego, or on what- 
ever else a therapeutic success may be said to 
be based. We may also maintain that life his- 
tories can be produced repeatedly with inter- 
ferences by previous performances of no great- 
er intricacy than we would find with other 
complex clinical tests. 


All the shortcomings of this method, such 
as reliance on what the subject himself tells 
about the pauses, too many variables, too little 
quantification, no complete elimination of 
social interaction and of its interference with 
the performance to uncontrolled degrees, etc. 
hold, in one way or another, for any clinical 
test. In the pause-analysis technique the em- 
phasis is on contents and dynamics and their 
clinical appraisal. Tendencies pertaining to 
the person’s (subject’s, patient’s) specific struc- 
ture and organization of the mind, but also 


to his performance and to the test situation 
can be traced via contents of the pauses and 
its placement in the context of the delivered 
life history, and any information that could 
not have been secured by other techniques in 
the same length of time will be valuable in 
clinical practice. The technique seems particu- 
larly promising in cases on which relatively 
little time can be spent. 


Summary 


A clinical technique has been described in 
which the subject is asked to tell his life 
history into the microphone for 5 to 10 
minutes. After that the subject and the experi- 
menter (counselor, therapist) go over the 
record and analyze the pauses the subject made. 
Some quantitative results of 35 subjects have 
been mentioned and four examples given. 
Theoretical implications, advantages and dis- 
advantages of this technique have been dis- 
cussed. 
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One important problem facing mental hy- 
giene clinics is attempting to evaluate before 
beginning therapy whether or not the patients 
have the capacity to profit from psychotherapy. 
Much time and energy ordinarily devoted to 
the unsuccessful treatment of cases might be 
more profitably diverted to the better therapy 
risks should it be possible to make such an 
evaluation correctly. Our problem, therefore, 
was to investigate the possibility of using the 
Rorschach test for prognostic purposes. In 
short, can the Rorschach test be used to pre- 
dict which cases will be successful in therapy 
in a mental hygiene clinic? 


Method 


The method used involved establishing cri- 
terion groups: one group composed of patients 
who were successful in psychotherapy; the 
other group composed of patients who were 
unsuccessful in psychotherapy. The first step 
was to proceed deductively to differentiate be- 
tween Rorschach protocols of patients in the 
criterion groups. The next step was to pro- 
ceed inductively to discover whatever differ- 
ences might exist between the criterion groups 
and then test these differences on a new 
sample. 


1 Reviewed in the Veterans Administration and 
published with the approval of the Chief Medical 
Director. The statements and conclusions published 
by the authors are the results of their own study 
and do not necessarily reflect the opinion or policy 
of the Veterans Administration. This paper was 
read at the 1951 meeting of the American Psycho- 
logical Association. 

2Also contributing to this research were Lewis 
Bernstein, David Ficks, Lillian Sandberg, and 
Joanne Knauss. 


Our deductive procedures included first, a 
“total impression” judgment. That is, psy- 
chologists read the patient’s Rorschach proto- 
col and predicted whether the patient was a 
member of the successful or unsuccessful 
group. Secondly, “signs” derived by Harris 
and Christianson [2] were utilized to assign 
the Rorschach protocol to either criterion 
group. Thirdly, predictions toward the cri- 
terion were made on the basis of whether the 
M present in the protocol was of the flexor or 
extensor type. Fourthly, two different com- 
binations of Rorschach variables thought like- 
ly to discriminate between the criterion groups 
were tried. The above four procedures, then, 
were a priori. 

Our inductive procedures followed the 
usual pattern of ascertaining differences be- 
tween “known groups.” First, various Ror- 
schach scores or variables were compared in 
the two groups. This comparison was made 
in terms of the percentage of persons in the 
criterion groups having a given score on a 
given variable. Secondly, patterns were devel- 
oped from an analysis of variables which 
seemed promising as discriminators and these 
patterns were applied to a new sample. The 
above two procedures, then, were a posteriori, 


Procedures and Results 


The procedure began with the establish- 
ment of the two criterion groups. One group 
consisted of 50 protocols of patients whose 
case file showed that at termination they were 
thought “unimproved.” The other group con- 
sisted of 59 protocols of patients terminated 
“slightly improved” or “improved.” The pro- 
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tocols were rescored according to Klopfer’s 
method — using, however, Beck’s tables of 
F+ and popular responses. All cases were 
selected at random from the clinic files, with- 
out regard to diagnosis or therapist. All sub- 
jects in the criterion groups, as well as in the 
cross-validation groups, were veterans who 
had had treatment at a Veterans Administra- 
tion Mental Hygiene Clinic. 

The judgments concerning the success of 
the patients in psychotherapy were made by 
the patients’ therapist in consultation with a 
senior psychiatrist. The senior psychiatrist was 
one who had been regularly consulted on the 
case. There were eight social workers, eight 
psychiatrists, and three psychologists involved. 


Deductive Procedures. 


The deductive procedures were as follows: 

Total impression judgments. Three psy- 
chologists, with Rorschach experience ranging 
from three to five years, judged each Ror- 
schach protocol for success or nonsuccess under 
four different conditions —each condition 
separated by at least a one-month interval. 


The procedure under Condition I was to 
make a snap judgment, in not more than two 
or three minutes, concerning success. The pro- 
cedure under Condition II was to make a 
studied judgment, with as much time allowed 
as was felt necessary by the psychologist 
making the judgment. Condition III was the 
same as Condition II except that the name of 
the patient’s therapist was given to the judge 
as additional data. Condition IV provided a 
check for Condition III in that the therapist’s 
name was given to the judge without the 
Rorschach protocol. That is, predictions of 


success were made from the therapist’s name 
alone. 


Validity coefficients were calculated for 
each psychologist under each condition and 
were expressed in terms of chi square com- 


%An objection to the use of chi square might be 
raised here on grounds that the judgment of one 
case was not independent of the judgment of an- 
other. An attempt to meet this objection was made 
by not telling the psychologist how many cases 
were in each criterion group and warning him that 
he was mot to assume that the criterion groups were 
nearly equal in number. Thus, it was hoped that 
the psychologist judged each new case independent- 
ly of how he had judged previous ones. 


puted for a four-fold table.* All results from 
the total impression judgments were negative. 
Predictions were no better than chance under 
all four conditions. Results are presented in 


Table 1. 











Table 1 
Validity of Total Impression Judgments 
; Type of Judgment — Dene 

weyeholegat Snap Studied Therapist 
A 

151 054 400 

p >.60 >.80 >.50 
B 

x? 1.166 156 516 

p >.25 >.60 >.40 
¢ 

x 1.37 1.22 035 

p >.20 >.20 >.80 





Interpsychologist and intrapsychologist 
agreement under each condition was also cal- 
culated and was expressed in terms of tetra- 


Table 2 


Tetrachoric r’s Indicating Inter- and Intrapsychol- 
ogist Agreement on Total Impression 
Judgments 
(Italicized numbers refer to intrapsychologist 
agreement) 








Psychologist 








A B S 
S 3 = fs 2 
o_o. s 2 2 2. 8 
ée”%66% @ @G *& 
A 
Snap 75 74 AA .30 
Studied 87 50 21 
Know 
thpst. 60 32 
B 
Snap 65 65 51 
Studied 53 46 
Know 
thpst. .27 
¢ 
Snap 85 80 
Studied 85 
Know 
thpst. 
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choric r. Tetrachoric r’s*for the judgments 
between different psychologists ranged from 
+.21 to +.60 and are presented in Table 2. 
Correlations above +.40 are significant at the 
5 per cent level. Five of the correlations 
range above +.40 and they are to be con- 
sidered significant. According to Wilkinson’s 
table [3] the probability of obtaining five 
correlations significant at the 5 per cent level 
by chance when nine are calculated is less 


than .0006. 


Tetrachoric r’s for the same psychologist 
under Conditions I — III ranged from +.53 
to +.87 and are presented in Table 2. All of 
these correlations are significant at the 5 per 
cent level, although how contaminated they 
are from judgment to judgment is urknown. 
The judges expressed the not unlikely point 
of view that contamination from condition to 
condition was minimal because of the large 
number of cases (109) and the time interval. 


Harris and Christianson’s scoring method. 
Weights for various scores as derived by 
Harris and Christianson [2] in their study on 
the use of the Rorschach in the prognosis of 
therapy were applied to our data. This pro- 
cedure did not discriminate between the cri- 
terion groups (v* = .110, »=.75). 

M responses. An analysis was made of all 
the M responses with regard to extensor or 
flexor quality. It should be noted that the ex- 
aminers did not press the subjects for the 
direction of movement; any such expression 
was completely unsolicited. M’s appeared in 
76 records; in 30 cases there were only 
flexor M’s, in 13 cases only extensor, in 12 
cases there were both, and in 21 cases the 
direction of movement could not be judged. 
Of the 30 cases in which there were only 
flexor M’s, 12 were improved cases, and 
18 unimproved ; of the 13 cases in which only 
extensor M’s appeared, 11 were improved and 
two unimproved. The presence of extensor 
M’s only, therefore, appears to be associated 
with improvement in therapy. These data 
seemed promising and are elaborated below. 

Response patterns. An attempt to differen- 
tiate between the criterion groups on the basis 
of different patterns of responses was made. 


“Splits closely approximate .50 — .50. Condition 
IV is omitted. 


Four variables were chosen, not because in 
combination they represented a particular per- 
sonality structure, but because of their im- 
portance as Rorschach variables. These vari- 
ables were R, M, F%, and XC. A second pro- 
cedure of this sort was made with five varia- 
bles, R, M, F%, number of rejections, and 
presence or absence of additional responses. 
The second procedure differs from the first 
in that the last two variables mentioned were 
included because they were regarded as use- 
ful prognostic signs. The hypothesis was that 
those patients with fewer rejections and a 
greater number of additionals would be the 
better therapeutic risks. 

A tabulation method was used to analyze 
the data. Space does not permit complete pre- 
sentation of this method here. See Hammond 
[1] for a detailed description of the method. 

In the first procedure each variable was 
broken into categories of High, Medium, and 
Low.® For example, Low R =O — 15, 
Medium R = 16 — 26, High R = 26+. For 
Low and Medium categories of R, M was 
categorized as follows: Low M = 0, Medi- 
um M=1, High M=2+. For the cate- 
gory of High R, Low M = 2 or less, Medium 
M = 3 - 5. High M = 6+. F% was cate- 
gorized as follows: Low F% = 0 — 40%, 
Medium F% as 41 — 60%, and High F% 
as 61%-+. XC was categorized in this fash- 
ion: For Low ranges of R, Low 2C = 0, 
Medium 2C = .5 — 1.4, High 2C = 1.5+. 
For Medium ranges of R, Low 2C = 0 — 
1.0, Medium 2C = 1.5 — 2.4, High 2C = 
2.5 +. For High ranges of R, Low SC = 0 
- 1.9, Medium 2C = 2.0 - 3.4, High 3C 
= 3.5+. 

For the second procedure, R, M, and F% 
remained as described above. Rejections were 
categorized in the same way for all values of 
R, Low rejections = 0, Medium rejections 
=1, High rejections —=2+. “Additionals” 
were categorized merely in terms of presence 
or absence. Results from the pattern analysis 
procedure were negative. By inspection it was 


5Decisions about the range in categories were 
made from an examination of the data obtained. 
Although recognized as a risky procedure, it ap- 
peared to be the most promising one and risks 
would be forestalled by use of a cross-validation 
group, if positive results were obtained. 
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obvious that the patterns used did not dis- 
criminate between the criterion groups. 

In summary, then, only one a priori method 
of prediction, type of M, seemed even promis- 
ing; the other methods offered no evidence of 
better-than-chance success. 


Inductive Procedures 


The inductive procedures were as follows: 
Single variables: The first step was the 
analysis of single variables, or scores, such as 
M, XC, F%, etc. Each such variable was 
examined to discover whether the percentage 
of persons achieving a certain score differed 


20 30 40 
PERCENTAGE OF OCCURRE 

Fig. 1. Percentage of responses occurring in criterion groups. (See Table 5 for responses indicated 
by numbers in this figure, e.g.. 1 — R < 20.) 


50 60 70 80 90 100 
NCES —IMPROVED GROUP 


in the criterion groups. For example, the per- 
centage of persons in the criterion groups who 
achieved three or more M’s was compared. 
The procedure for choosing cutting points 
was deliberately that of choosing those cutting 
points which seemed empirically most promis- 
ing. There were two reasons for this pro- 
cedure: (a) The study had now become a 
frankly empirical one and cross-validation was 
planned, and (4) it very soon became ap- 
parent that few large differences were going 


to be found. 


Ninety-nine percentages were compared and 
are presented pictorially in Fig. 1 by means of 
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a method developed by Zubin [4]. It will be 
noted from the figure that the results are 
negative. None of the variables produced sig- 








Table 3 
Rorschach “Signs” Corresponding to Numbers 
In Figure 1 

1. R less than 20 52. Categories more 

2. R less than 10 than 6 

3. R40 or more 53. Categories more 

4. M presence than 8 

5. M more than 1 54. Rejection presence 

6. M more than 3 55. Cut-off 3 or more 

7. FM presence 56. At presence 

8. FM 4 or more 57. At more than 2 

9. FM more than 4 58. At more than 3 

10. m presence 59. Sex presence 

11. Add. m presence 60. N or Geog presence 
12. & presence 61. Art/Des presence 
13. & more than 1 62. Nature presence 
14. K presence 63. Geog presence 
15. FK presence 64. Clouds presence 
16. FK 3 or more 65. Blood presence 

17. F 4or more 66. Fire presence 
18. F 3 or more 67. AD>A 

19. Fe presence 68. F% more than 70 
20. Fe 3 or more 69. F% more than 50 
21. ¢ presence 70. F% less than 30 
22. C’ presence 71. F% 60 or more 
23. FC presence 72. F% less than 40 
24. FC more than 2 73. Shading absence 
25. FC more than 1 74. Shading 15% or more 
26. CF presence 75. Shading 20% or more 
27. CF more than 1 76. Shading 30% or more 
28. CF more than 2 77. Sum C0 
29. FC > CF 78. Sum C less than 2 
30. FC to0 CF 79. Sum C more than 4 
31. CF > FC 80. Sum C less than 1.5 
32. CF to0 FC $1. CF > FC@ 
33. Presence of CF or FC Sum C > 3 
34. Presence of C 82. M:Sum C . Same 
35. Human absence as OM/OC 


% last 3 :24 or less 
% last 3:30 or less 


36. Humanmorethan3 83. 
37. Humanmorethan2 84. 


38. Hd presence 85. % last 3:45 or more 
39. Hd more than 1 86. % last 3:40 or more 
40. Hd more than 3 87. % C less than 10 
41. Hd>H 88. % C 20 or more 

42. A% 50 or more 89. % C13 or less 

43. 4% 60 or more 90. W% > 50 

44. A% 30 or less 91. W% 30 or less 

45. Populars 5 or more 92. W% < 20 

46. Populars 2 or less 93. W% 45 or more 
47. Populars 8 or more 94. D% 30 or less 

48. A >Ad 95. D% 40 or less 

49. Aobj presence 96. D% 65 or more 

50. Obj presence 97. D% 41-60 

$1. Others presence 98. S presence 


99. S more than 1 





nificant differences between the criterion 
groups.®° Table 3 gives a list of the signs 
tested, corresponding to the numbers in Fig. 
1. 


Rules for prediction. After examination of 
Fig. 1, and using the analysis of the M’s, 
rules were set up which seemed most likely to 
discriminate between the criterion groups. 


These rules are listed in Table 4. The rules 


Table 4 


Prediction Rules 








I. Considering type of M 

Improvement: 

1. Presence of extensor M and % C > 10 

2. Presence of flexor M, absence of small m, 
FC >2 

3. Presence of flexor M, presence of CF or FC, 
Yo C > 10, absence of object, presence of N 
or G 

4. Presence of M that is neither E or F, ab- 
sence of small m, FC > 2, % last 3 <. 40 

5. Presence of M that is neither E or F, and 
absence of object 

Unimprovement: 

6. Presence of extensor M, presence of CF or 
FC, % C < 10, presence of object 

7. Presence of flexor M, % last 3 > 40, except 
when FC > 2 

8. Presence of flexor M, % C < 10, CF or FC 
present, presence of object, and N or G 

9. Presence of M that is neither EZ or F, pres- 
ence of CF or FC, % € > 10, presence of 
object, N and G absent 

II. Without regard to M 

Improvement: 

10. No small m, =C > 0, % last 3 < 40 

11. Presence of CF or FC, % C > 10 

Unimprovement: 

12. No small m, ZC = 0 

13. % C < 10, presence of object, and N or G 


+ 





were then applied to a new sample of 104 
cases, of whom 70 were improved, and 34 
were not. Upon application, it was noted that 
the rules were not mutually exclusive. It was, 
therefore, decided that each case would be 
judged only once. Since it appeared from our 
original sample that we could predict success 
more accurately than failure, if a case fell in- 
to a category predicting success, that category 
was the only one used. If a case fell into more 
than one category, it was put in the one with 

®Only those patients who had at least 5 inter- 


views are included here. Identical procedures were 
used with the total group with negative results. 
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which the most favorable results had previous- 
ly been obtained in the original sample. It 
should also be noted that many cases do not 
fall under any of these rules and therefore are 
not judged. Results for each rule are pre- 
sented in Table 5. 


Table 5 
Results of Empirical Pattern Analysis 
(First sample N = 50 Improved, 59 Unimproved; 
Second sample N — 70 Improved, 34 Unimproved) 











n ms 3 2 g 
Rules* f: s E § su E ao £ 2 .8 
BFS FEZZHSRE ZB 
Considering 
type of M 
Extensor M 
$1 = 12 2 
(6)+ a ait 
2 6 
Flexor M 
£2 2 0 5 0 
33 he 2 0 
(27) + oy i 
(28 5 2 1 1 
11 11 
M neither 
E nor F 
4 7 2 8 1 
(25)t 2 0 Bn 
(29) h.- 3 
4 10 
Without 
regard to M 
210 eF¢ Ame 
11 42 23 2.0CO« 
(212)+ _ 7* 10 
(13) 11 + 9 7 
6 11 





*See Table 4 for rules. Rules are numbered in accord- 
ance with their number in Table 4. 

+Numbers in parentheses refer to rules which predict 
wi.improvement and vice versa. 


The results of the cross-validation study 
are described in detail below and are pre- 
sented in tabular form in Table 6. 

Predicting Improvement: (a) Empirically 
derived rules for predicting improvement 
which include consideration of M do appear 
to predict improvement better than chance 
(see A, Table 6). (6) Empirically derived 






































Table 6 
Validity of Empirical Rules 
A. B. 
Pred. Imp. with M Pred. Imp. W.O. M 
Imp. Ui. Imp. Ui. 
With rule 730] 4] 34 With rule [44716] 60 
W.O. rule |[40]30] 70 W.O. rule |26]18] 44 
70 34 104 70 34 104 
x? = 10.05 x? == 2.34 
p—<.01 o= 
D. 
Pred. Unimp. with M Pred. Unimp. W.0. M 
Imp. Ui. Imp. Ui. 
With rule [5] 6] 11 With rule [17]i6] 33 
W.O. rule |65]28] 93 W.O. rule | 53]18] 71 
70 34 104 70 34 104 
x2 — 2.66 x2=— 5.47 
p— .10 p—<.02 





rules for predicting improvement which do 
not include M do not quite reach the usual 
criterion for better-than-chance prediction (see 
B, Table 6). 

Predicting Unimprovement: (a) Empir- 
ically derived rules which include the con- 
sideration of M do not quite reach the usual 
criterion for better-than-chance prediction 
(see C, Table 6). (4) Empirically derived 
rules which do not include consideration of 
M do predict unimprovement better than 
chance (see D, Table 6). The above statistical 
presentation is modified below so that the 
results are made more clinically meaningful. 
For example, one might ask whether these 
data indicate when the use of M in clinical 
prediction is warranted. 

Rules including M: When attempting to 
predict improvement using rules which in- 
clude M, predictions could be made in 34 cases 
(32% of the total) ; these predictions proved 
to be correct in 30 instances (see A, Table 6). 
Apparently, when M is present this is a useful 
procedure. However, when attempting to pre- 
dict unimprovement (using M) predictions 
could be made in only 11 cases (10% of 
total), 6 of which were correctly predicted 
(see D, Table 6). This does not appear to 
be a useful procedure. Thus, the clinical use 
of M seems indicated when predicting im- 
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provement, but not when predicting unim- 
provement. 

Rules which do not include M: When at- 
tempting to predict improvement using rules 
which do not include M, predictions could be 
made in 60 cases (58% of total) ; these pre- 
dictions proved to be correct in 44 instances 
(see B, Table 6). This seems to be a clinical- 
ly useful procedure, for the psychologist was 
correct about three-fourths of the time. Note, 
however, that the odds are biased in the psy- 
chologists’ favor when predicting improve- 
ment, for the odds are about 2 to 1 that any 
given case in the population will be improved. 
It is for this reason that this rule does not 
quite reach the usual 5% criterion. 

When attempting to predict unimprovement 
using rules which do not include M, the psy- 
chologist could predict for 33 cases (31% of 
the total). The psychologist was correct 
about 50% of the time (see C, Table 6). 
This hardly seems to be a useful procedure, 
even though better-than-chance prediction is 
achieved. Thus, procedures which exclude M@ 
from consideration se~>m useful clinically when 
predicting improvement only. 

In brief, then, these data indicate that the 
rules for predicting improvement would be 
clinically useful, with or without the use of 
M, and that the rules for predicting unim- 
provement would not be clinically useful, 
with or without the use of M." The reader 
should note again that in this population pre- 
diction of improvement is much easier than 
prediction of unimprovement because of the 
distribution of cases, i.e., there are far more 
improved cases~-thus any prediction of im- 
provement is more likely to be right than 
wrong. 


Discussion 


These results point to the fact that single 
factors on the Rorschach are not sufficient for 
predictive purposes. However, combination of 
factors, i.e., empirically determined rules for 
prediction, may be used with some measure of 
success for certain cases. The rules tested in 
this study were the first ones selected, and it 


TWhile differences in efficiency could be evalu- 
ated statistically, the prediction rules hardly seem 
well enough grounded to warrant such refinement. 


is quite probable that they are not the best, 
nor the only rules which might be derived 
from the data. For example, shading responses 
were not considered nor were location re- 
sponses. Other factors may well be considered. 
For example, we used a representative clinic 
sample, without regard to diagnosis or thera- 
pist. It is quite possible that if the patient 
population were stratified with regard to diag- 
nosis and therapist, that greater precision 
might be obtained. However, the results ob- 
tained appear promising and further investi- 
gation seems appropriate. 

On the other hand, the negative character 
of the results of our a priori procedures 
should not be overlooked. In this study, four 
procedures which might reasonably have been 
expected to have predictive value, did not ap- 
proach success. Consider especially the “total 
impression” results. Here intrapsychologist 
agreement was higher than interpsychologist 
agreement. Thus, one might speculate that 
three rather different methods of “total im- 
pression” judgment were used rather consis- 
tently without success. 


Our conclusion is that while the Rorschach 
test may be used for prognostic purposes suc- 
cessfully by some psychologists, there is em- 
phatic need for further empirical check; in- 
deed, empirical work may make prognosis 
from the Rorschach explicit and practical.® 


Summary and Conclusions 


1. Rorschach records of 109 unselected vet- 
erans who had been in treatment were used 
to predict outcome of treatment. 


2. Psychologists experienced in the use of 
the Rorschach did not make better-than-chance 
predicitions of outcome of treatment under 
three separate methods of studying the Ror- 
schach protocols. 


3. Combinations of four variables in one 
instance, and five variables in another, also 


8After this article was submitted for publication, 
an article by G. Filmer-Bennett entitled “Prognostic 
indices in the Rorschach records of hospitalized pa- 
tients” appeared in J. abnorm. soc. Psychol., 1952, 
47, 502-506, in which the author noted that “The 
foregoing results failed to reveal any sharp trends 
in Rorschach performance which were significantly 
related to outcome of treatment or which compared 
with those reported in earlier studies.” 
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failed to discriminate between the criterion 
groups. 

4. The results obtained by Harris and 
Christianson for their group did not predict 
successfully for this group. 

5. There was some evidence that extensor 
M’s, when they appear alone in a record, are 
associated with improvement in therapy. 

6. Ninety-nine Rorschach “scores” were 
examined, and did not differentiate between 
the criterion groups. 


7. Rules for prediction obtained on an 
empirical basis, and cross validated, showed 
definite promise of utility. The rule most use- 
ful permitted predictions in about one-third 
of the cases examined, and showed correct 


predictions at the 1 per cent level of confi- 
dence. 


Received July 14, 1952. 
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This study is the second in a series of in- 
vestigations designed to determine Rorschach 
criteria for predicting continuation in psycho- 
therapy. The hypothesis for the study was 
suggested by the results of an initial study of 
group psychotherapy patients [3]. These re- 
sults had indicated that a group of neurotic 
patients who continued in group psycho- 
therapy had, on the average, higher FC minus 
CF, R, and D% Rorschach scores than a 
matched group of patients who discontinued 
group psychotherapy without the consent of 
the psychotherapist. A weighted combination 
of the three Rorschach scores derived by a 
discriminant function analysis permitted an 
accurate allocation of each patient to a “con- 
tinuing” and “noncontinuing” group in 69 
per cent of the cases. A chi-square test indi- 
cated that this percentage of successful alloca- 
tion was significant beyond the 1 per cent 
level. 

The aim of the present study was to deter- 
mine at an empirical level whether the three 
Rorschach variables which were useful in 
determining continuation in group psycho- 
therapy could predict the same behavior in 
individual psychotherapy. 


Subjects and Procedure 
The Rorschach records of twenty-six “con- 


1Reviewed in the Veterans Administration and 
published with the approval of the Chief Medical 
Director. The statements and conclusions published 
by the authors are the results of their own study 
and do not necessarily reflect the opinion or policy 
of the Veterans Administration. The authors wish 
to thank Dr. Donald H. Bullock, University of Buf- 
falo, for his help in preparing the manuscript for 
publication. 
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tinuing” and twenty-six “noncontinuing”’ pa- 
tients were selected at random from the test 
files of the Boston Mental Hygiene Unit, 
Veterans Administration. A patient was classi- 
fied as “continuing” if he attended the first 
nine psychotherapy sessions without severing 
his relation to the clinic. A patient was classi- 
fied as “‘noncontinuing” if he had accepted in- 
dividual psychotherapy, but ceased keeping ap- 
pointments without the psychotherapist’s con- 
sent before the ninth psychotherapy session.” 

The fifty-two Rorschach records were all 
those of white, male veteran patients referred 
for individual psychotherapy. The patient 
group was a predominantly neurotic popula- 
tion with the exception of a few latent schiz- 
ophrenics and behavior disorders. The age 
range was from nineteen to forty years with 
a mean age of twenty-eight years. The educa- 
tional level of the group ranged from eight 
to fifteen years, with a mean of twelve years. 
There were as many married as single men. 
The majority were of Catholic faith. The oc- 
cupations varied, with a fairly even distribu- 
tion of students, clerks, skilled, semiskilled, 
and unskilled workmen. 

The Rorshach tests had been administered 
by members of the Psychological staff of the 
Boston Mental Hygiene Unit according to the 
standard procedure described by Klopfer [2]. 
The scoring of each protocol was checked by 
the senior author to insure uniformity and 
accuracy. 

The design of the experiment provides for 
two statistical comparisons: (a) between the 

2The same number of sessions attended was used 


in this study as in the previous group psychother- 
apy study [3]. 
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means of the continuing and noncontinuing 
groups on each of the three Rorschach vari- 
ables, FC minus CF, D%, and R.; and (6) 
between the continuing and noncontinuing 
groups on a weighted Rorschach score ob- 
tained by combining the three variables ac- 
cording to the discriminant function equation 
derived from the previous group psycho- 
therapy study. 


Table 1 


Means of Continuing and Noncontinuing Psycho- 
therapy Groups for Three Rorschach 














Variables 
Variable Continuing Noncontinuing 
group group 
FC—CF +.19 —1.08 
D% 53.88% 45.46% 
R 28.8 16.46 
Results 


The means of the three Rorschach vari- 
ables, FC—CF, R, and D% for the continuing 
and noncontinuing groups of patients are pre- 
sented in Table 1. The data indicate that the 
mean FC minus CF and R scores for the con- 
tinuing group is higher than the corresponding 
means for the noncontinuing group. The tests 
of significance between the means yield a 
probability level of .01 for the FC minus CF 
mean difference and .02 for the R mean dif- 
ference. The difference between the mean 
D%’s of the continuing and noncontinuing 
groups is not significant. 


The results of the present experiment which 
used individual psychotherapy patients as sub- 
jects in general parallel the results obtained 
in the previous group psychotherapy experi- 
ment. The mean FC minus CF and R scores 
of the continuing groups of patients are sig- 
nificantly higher than the corresponding means 
for the noncontinuing groups in both experi- 
ments. In both experiments the mean R scores 
for the continuing groups are higher than the 
mean R scores for the noncontinuing groups. 
The test of significance for the individual 
psychotherapy experiment yielded a much 
lower probability level. The » for the individ- 
ual psychotherapy experiment was .02; for the 
group psychotherapy experiment it was .01. 
The difference between the mean D% for the 


continuing and noncontinuing individual psy- 
chotherapy groups was in the opposite direc- 
tion to that found in the group psychotherapy 
experiments. In the earlier experiment, how- 
ever, the difference had only been significant 
at the .2 level. 

The results of the discriminant function 
analysis performed in the first experiment had 
yielded the equation 


z—=00241397x, + .00006969x. + .00038326xs5 


in which x, is the FC minus CF score, x. 
is the D% score and x; the R score.* In the 
present experiment a z score was accordingly 
obtained for each patient by substituting his 
empirical FC minus CF, D% and R scores 
in this equation. The distributions of z scores 
for the continuing and noncontinuing individ- 
ual psychotherapy groups are presented in 
Table 2. To facilitate comparison with the 
results of the previous experiment, the com- 
parable distributions of the continuing and 
noncontinuing group psychotherapy patients 
are presented in the same table. 


Table 2 
Frequency Distribution of z Scores for Continuing 
and Noncontinuing Psychotherapy Groups 











we 

6a 33 8&8 23 
2 score class intervals gas is 58 58 
SS 858 se &8 

$23 Sas $3 

622 228 SE SE 

1. -.00283112 — .00000000 0 3 0 0 
2. .00000000 — .00283112 1 3 0 0 
3. .00283112 —.00566224 3 4 > 
4. .00566224 — .00849336 1 3 : 
5. .00849336 —.01132448 6 8 11 17 
6. .01132448 —.01415560 3 4 4 0 
7. .01415560 —.01698672 3 0 9 a 
8. .01698672 —.01981784 2 1 1 2 
9. .01981784— .02264896 2 0 2 1 
10. .02264896 — .02548008 2 0 2 0 
11. .02548008 — .02831120 0 0 0 0 
12. .02831120 —.03114232 3 0 1 0 
Total N 26 26 42 56 





Table 2 indicates considerable overlap be- 
tween the continuing and noncontinuing 
group’s distribution of scores. All distributions 
are skewed towards the lower end of the z 

®The D% score was multiplied by the constant 


100 to eliminate the decimal point and simplify the 
calculations. 
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score range. There is, however, a greater pro- 
portion of patients with lower < scores in the 
noncontinuing groups than in the continuing 
groups in both the group and individual psy- 
chotherapy distributions. 


Table 3 
Test of Significance between Mean z scores of Con- 
tinuing and Noncontinuing Groups for In- 
dividual Psychotherapy 











Standard Stand- 
Mean 7 devi- ard Critical 
N scores ations errors ratio p 
Noncon- 
tinuing 
group 26 6.006878 .004638 .000926 
4.02 <.01 
Continuing 
group 26 .014478 .00822 .001645 





The results of the test for the significance 
between the means of individual psychotherapy 
continuing and noncontinuing groups are pre- 
sented in Table 3. Table 3 indicates that the 
continuing group has a higher mean z score 
than the noncontinuing group. Since the direc- 
tion of this difference was postulated by hy- 
pothesis, a one-sided significance test is justi- 
fied and the critical ratio is accordingly signifi- 
cant at the 1 per cent level. 

Empirical inspection of the z-score frequen- 
cy distributions of the group psychotherapy 
patients indicated that the value z—.01132448 
represented the cutting point which produced 
the minimum overlap between the continuing 
and noncontinuing groups. In the present ex- 
periment, if we call all those cases above this 
point continuing and all those cases below it 
as noncontinuing, we find that we have pre- 
dicted 36 correct placements and 16 incorrect 
ones. To determine whether this result could 
have been obtained by chance, a chi square was 
computed. The chi square was 7.69, a value 
which is significant beyond the 1 per cent 
level. 


Discussion 


An evaluation of the results of both experi- 
ments suggests the conclusion that the FC 
minus CF and R variables clearly differentiate 
continuing and noncontinuing patients 
whether in group or individual psychotherapy. 
The second conclusion which emerges from 


the data is that the D% is probably not a use- 
ful differentiating index in either type of psy- 
chotherapy. 

When the three Rorschach variables are 
combined into one predictive index by a dis- 
criminant function analysis, the results for 
the individual psychotherapy experiment close- 
ly parallel those obtained in the group psycho- 
therapy experiments. In both cases, the anal- 
ysis yielded correct predictions in precisely 69 
per cent of the cases. 

In the group psychotherapy experiment, the 
discriminant function equation and cutting 
point z score were empirically derived. Ac- 
cordingly, it was expected that the experi- 
mental error would reduce the accuracy of 
prediction in the individual psychotherapy ex- 
periment. The striking similarity of the re- 
sults of the second experiment to those of the 
first greatly increases the degree of confidence 
with which the relationship, mathematically 
expressed by the discriminant function equa- 
tion, can be accepted. However, future pre- 
dictions would probably be more accurate if 
only the FC-CF and R variables were utilized 
in the equation. ‘ 

The experimental results are even more 
impressive when certain differences between 
the designs of the two experiments are more 
closely examined. The type of subjects used 
in the experiments differed in many respects. 
In the first experiment 71 per cent of the 
subjects were obese nonveteran patients, and 
29 per cent were neurotic veteran patients. All 
of the patients of the second experiment were 
veterans, most of whom were neurotic. 
Thirty-three per cent of the subjects of the 
first experiment were over 40 years of age. 
All of the patients of the second experiment 
were under 40 years of age. Over 50 per 
cent of the patients in the first experiment 
were women. The patients in the second ex- 
periment were all men. 

Despite the differences in the types of sub- 
jects studied, the similarity of the results 
suggests that at least some of the personality 
factors which determine continuation in group 
psychotherapy determine continuation in in- 
dividual psychotherapy. 

Other personality factors not measured by 
the methods employed in these experiments 
might indicate some differential reaction 
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to the two types of psychotherapy. Similarly, 
factors other than those related to personality, 
such as method of psychotherapy, personality 
of psychotherapist, group composition, etc., 
may also be important determinants of 
whether a patient continues or discontinues 
psychotherapy. 

The problem arises as to how to account 
for the results of the two experiments on a 
theoretical level. 

It is assumed that the motivation of pa- 
tients who undertake psychotherapy is am- 
bivalent. On the one hand, they wish to con- 
tinue psychotherapy in order to relieve their 
symptoms. On the other hand, they wish to 
discontinue psychotherapy because of the 
anxiety aroused by the psychotherapeutic pro- 
cess. 

It is further assumed that patients with 
greater FC minus CF and R scores have a 
greater capacity to tolerate the anxiety aroused 
by the psychotherapeutic process and accord- 
ingly remain in psychotherapy. Conversely, 
patients with relatively low FC minus CF 
and R scores have a lesser capacity to tolerate 
the anxiety aroused by the psychotherapeutic 
process and accordingly, discontinue psycho- 
therapy. 

There are several facts which support this 
second assumption. Williams [5] reports a 
positive correlation between the number of 
FC responses and a subject’s capacity to with- 
stand experimentally induced stress. A study 
by Eichler [1] indicates that experimental 
stress produces a significant decrement in the 
R variable. It is possible that the patients 
with low FC minus CF and R Rorschach 
scores at the beginning of psychotherapy have 
initially a greater amount of anxiety than the 
patients with higher FC minus CF and R 
scores. They are accordingly relatively unable 
to tolerate the additional amount of anxiety 
induced by the psychotherapeutic process. 

Rogers, Knauss, and Hammond [4] have 
recently published the results of a study 
similar to the one reported here. These 
authors attempted to determine whether the 
Rorschach test would aid in predicting wheth- 
er an outpatient would return to the clinic for 
five or more interviews. On the basis of their 
results, the authors conclude that this be- 
havior cannot be predicted by the Rorschach 


test, although they qualify their conclusion 
with the proviso that future, more extensive- 
ly controlled studies might yield positive re- 
sults. The contrasting results of the study of 
Rogers, et. al., and those of the present study, 
require some theoretical interpretation. 

A possible explanation can be formulated 
in terms of the differences in the methodology 
employed in the two studies. Rogers, et. al. 
used two methods for analyzing their Ror- 
schach data: (a) clinical impression judg- 
ments of the entire Rorschach protocol, and 
(b) statistical comparisons of ninety-nine in- 
dependent scores or signs. An objection to the 
use of the first method is that there was in- 
sufficient reliable information about the re- 
lationship of the independent variables (the 
Rorschach factors) to the dependent variable 
(continuation in therapy) to permit the for- 
mulation of a fruitful hypothesis. This judg- 
ment is admittedly a “Monday morning 
quarterback” type of criticism, but it is at 
least supported by the results of the Rogers 
study. 

The sign method involves similar difficulties. 
The cutting points for each of the “signs” are 
derived on an a priori basis. The previously 
suggested point, that the present area of in- 
vestigation is a relatively unexplored one, may 
also be considered as an objection to the use 
of a priori cutting points. In addition, the 
sign method is subject to the criticism that it 
violates the Gestalt quality of the classical 
Rorschach interpretive procedure. 

The discriminant-function method em- 
ployed in the present series of studies preserves 
the advantage of a method which provides 
for the simultaneous consideration of several 
Rorschach factors without sacrificing the ob- 
jectivity afforded by precise quantification. 


Summary 


Results of a previous study of group psy- 
chotherapy patients suggested the hypothesis 
that continuation or noncontinuation in psy- 
chotherapy was a function of three Rorschach 
factors, FC minus CF, D%, and R. The aim 
of the present study was to test this hypoth- 
esis on individual psychotherapy patients. 

Two methods were employed. The first 
method consisted of comparing the means on 
each of the three Rorschach variables of a 
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group of patients who discontinued individual 
psychotherapy with the means on the same 
variables of a group of patients who continued 
individual psychotherapy. The second method 
consisted of comparing the same continuing 
and noncontinuing groups of patients on a 
weighted Rorschach index. This index was 
obtained by the solution of a discriminant 
function equation empirically derived from 
the previous investigation of group psycho- 
therapy patients. Twenty-six continuing and 
26 noncontinuing clinic outpatients were used 
as subjects. The following results were ob- 
tained: 

1. The average FC minus CF and R 
scores of the continuing patients were signifi- 
cantly higher than those of the noncontinuing 
patients. 

2. The difference between the two groups 
of patients on the D% variable was not sig- 
nificant. 

3. The discriminant-function-weighted Rer- 
schach index yielded a correct prediction in 
36 out of 52 cases. A chi-square test of the 
statistical significance of this prediction re- 
sulted in a probability value of less than 1 
per cent. 


The results are interpreted in terms of an 
hypothesis which postulates that patients with 
relatively high FC minus CF and R Ror- 
schach scores have a greater capacity to toler- 
ate the anxiety aroused by the psychothera- 
peutic process than patients with relatively 
low FC minus CF and R Rorschach scores. 


Received July 22, 1952. 
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Intelligence, Verbal Fluency, and the 
Rorschach Test’ 


Erwin J. Lotsof 


Ohio State University 


It is implied in the literature that some 
Rorschach scoring categories have relatively 
distinct meanings: that is, they are related to 
independent personality variables. However, 
there is relatively little experimental work on 
the demonstration of this univocality. Hypoth- 
eses often engendered from a Rorschach pro- 
tocol seldom can be tested or perhaps more 
important, they do not conform to the formal 
conditions of testing hypotheses. The terms 
in the Rorschach are rather vague, ambiguous, 
and almost defy being operationally defined ; 
one need only examine words like “libidinal 
urges,” “central anxiety,” etc. “The problem 
facing the scientific psychologist is not, is the 
Rorschach valid, but, what aspects of the Ror- 
schach are valid, and what are its limitations 
and uses?” [5, p. 306]. Wittenborn [9] using 
a factorial technique has shown that there is 
in fact much overlap in the scoring categories 
of the Rorschach using a college population. 
In an unpublished paper, Schroder [8] also 
has found much overlap in the Rorschach cate- 
gories in a sample composed of individuals hav- 


ing Binet IQ’s of 60-80 and CA’s of 11.5 
to 13.0. 


It would appear on the basis of traditional 
Rorschach interpretations that scores are unre- 
lated to the verbal fluency of the subject. 
From the point of view taken in this paper 
and implied by others [3] such a positive re- 
lation is expected to hold. In the clinical situ- 
ation, one often sees the “verbal” individual 
produce large numbers of responses and with 
it a rather large number of determinants. The 
question then arises do these determinants ac- 


1Read in part at the Midwestern Psychological 
Association meetings 1951. The writer wishes to 
thank Dr. J. B. Rotter and Dr. R. Wherry for their 
aid in this investigation. 
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tually give us the “core” of the personality 
or are they reflections of the patient’s ability 
to verbalize. It was the hypothesis of this 
study that an explanation of the obtained 
overlap might be found in the possible rela- 
tionship of the scoring categories to general 
verbal fluency. The Rorschach protocol is 
after all a sample of the subject’s verbal rep- 
ertoire. For example, it is virtually impossible 
to score for movement if the subject does not 
employ an action term in his response; like- 
wise the scoring of shading implies the pres- 
ence of certain descriptive terms in the proto- 
col. If it were demonstrated that various Ror- 
schach categories are not independent of each 
other, and if it were demonstrated at the same 
time that they are related to external criteria 
of verbal facility, then one would be tempted 
to question the validity of certain Rorschach 
interpretations. Factor analysis appeared to be 
the most useful technique for approaching this 
problem. If, as some Rorschach workers claim, 
the several determinants are independent, they 
should manifest themselves as isolated factors 
in a factor analysis. 


Subjects and Procedure 


A group of thirty coilege students, male and 
female, stratified on intelligence as measured 
by the Ohio State Psychological Examination, 
participated in this investigation. Three stu- 
dents were selected randomly from each decile 
of the OSPE. None of the subjects had taken 
the Rorschach prior to the present situation. 
The experimental situation consisted of two 
parts, both of which were recorded by the use 
of a concealed microphone. In Part 1, the sub- 
jects gave verbal descriptions of five hypotheti- 
cal situations. In Part 2, each subject was ad- 
ministered the Rorschach test. 
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The hypothetical situations used are as fol- 
lows: 


1, What are the two main streets which inter- 
sect in your town? Just imagine that you are back 
there now on the corner. It is 12 o'clock noon on 
‘ Saturday. Tell me at ‘ength everything you see and 
what is happening. 

2. I would like you to tell me as much as you 
can as to what you do for recreation. Tell me all 
about it. 

3. Suppose that you have not had a vacation for 
a long period of time and one day someone gives 
you all the money that you need to go on a trip. 
Tell me at length all about the trip that you would 
take. 

4. Do you know where the oval is? Well, just 
imagine that you are in the center of the oval and 
you are telling some friend from home about every- 
thing you see. What would you tell them. 

5. What is the easiest thing for you to talk 
about? Tell me as fully as possible all about it or 
a modification of this to fit the subject’s topic. 


At the termination of Part 1, the subject 
was told that the experimenter wanted him to 
do something different. At this time the Ror- 
schach was administered employing the in- 
structions advocated by Beck. In order to mini- 
mize the possibility of experimenter bias in- 
fluencing the number of determinants, a rigid 
inquiry technique was employed. After the 
free association period, the examiner asked the 
following questions for each response pro- 
duced: 


1. Show me the - - - - - - ? 
2. What gave you the idea that it was a - - - -? 


3. Can you tell me anything else that suggested 
that it was a - - - - - ? 


After the above questions were asked, no 
attempt was made to probe for additional in- 
formation. The Rorschachs were scored using 
the notations employed by Beck. 


For present purposes verbal fluency was 
measured by counting the total number of 
words spoken, number of adjectives, and num- 
ber of verbs. 


The following criteria were used to evaluate 
the verbal output. 


Nouns used as adjectives are counted as adjec- 
tives. Examples: psychology course; toy rifle. 

Proper nouns used as adjectives are not counted. 
Examples: Baker Hall; South America. 

Where colloquialisms or incorrect grammar are 
used, part of speech designated is that of the sub- 


ject. Examples: It’s real quiet. Real here is an ad- 
verb and quiet is the adjective. 

Verbs used as nouns (gerunds) are not counted. 
Example: I can’t get too much studying done. 
Studying is the gerund. 

Dangling participles are counted as adjectives. 
Going into Columbus, High Street runs north and 
south. 

Verbs used as adjectives, participles, are counted 
as adjectives. Example: You'd probably see people 
standing in groups. Standing modifies people. 

Possessive forms of pronouns are not counted as 
adjectives, possessive adjectives. 

The verb to be was not counted as a verb. 

Auxiliaries were not counted as separate verbs. 
These were part of the main verb. 

When standing alone they were counted. 

Infinitives were not counted. 

Limiting adjectives were not counted. Examples: 
This, those, some, many. 

Ah’s and similar “feeling” statements were not 
counted as words. 


Not all of the Rorschach scoring categories 
were used in study. The method used in se- 
lecting the scoring categories was that these 
categories be relatively unaffected by the sub- 
ject’s verbal fluency; for example “affect” and 
“anxiety.” The Rorschach attempts to get at 
basic personality variables such as “fantasy,” 
“emotionality,” “control,” etc. From Ror- 
schach literature it was felt that selecting the 
crucial determinants would not be related to 
verbal fluency. Although the superficial aspects 
of personality vary as a function of the situa- 
tion, the core of the personality remains con- 
stant. On this basis, it would be expected that 
verbal fluency should be unrelated to Ror- 
schach determinants. 


Product-moment correlations were obtained 
among all the variables used at the present 
time. These variables included Rorschach 
scores and verbal measures. The resulting cor- 
relations were then subjected to a factor analy- 
sis using a multiple extraction process to fa- 
cilitate handling of the data. The criterion of 
simple structure was employed in the rotation 
of the factors extracted. 


Inspection of the correlational matrix, 
Table 1, shows, for this sample, disagreement 
with expectations derived from Rorschach the- 
ory. An interesting finding is obtained when 
M is correlated with Sum C. The obtained 
correlation of 0.54 is difficult to interpret stay- 
ing within the realm of Rorschach theory; one 
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Table 1 
Intercorrelations of Rorschach Determinants and Verbal Measures 
Total Ad ec- 

Variable OSPE Words tives Verbs M R W% XC A+Ad% Y V 
OSPE x 31 .33 28 .20 07 15 Al 19 .22 33 
SE i rcetecrsticivesceannnnsaeais 31 x 91 .97 40 51 .09 51 —.04 .66 15 
pe ee 33 91 xX 82 .33 48 .05 33 .08 57 15 
Be ne ee Re Vlaendidad .28 97 82 x 42 45 15 56 —01 62 15 
M = _ .20 40 33 fl x 41 14 54 -—26 48 52 
R voninfamnnniienen .07 51 A8 45 41 xX -.29 67 -.16 81 17 
RRA RT, 15 .09 .05 15 14 -.29 xX 13 04 -.07 03 
eth es aed a ata et Aa ll 51 33 56 54 67 13 x -.39 79 30 
(. fy See eee 19 =.04 .08 01 -26 —-16 04 --.39 xX -17 -.26 
Se EEE a es .22 66 .57 62 48 81 -.07 79 -.17 X 24 
FF a a nccilsnsivintliguasictnlisinitiie 33 15 15 5 52 17 .03 .30 


—.26 24 X 





might expect that the correlation should ap- 
proximate zero or there should be an inverse 
correlation for a “normal” population. It 
seems necessary to conclude for this sample 
that there is a moderate degree of overlap 
between the M and C categories. Another 
pertinent finding is the correlation of 0.79 
between Y and C. This suggests that these 
two determinants are not as distinct as 
claimed in the Rorschach literature. Accord- 
ing to Rorschach theory, the correlation 
should approximate zero; it would seem rather 
dificult to maintain that Y and C are measur- 
ing different behaviors. 


The factor analysis was based on thirty 
cases. With a sample of this size, the result- 
ing factor loadings should be interpreted with 
some degree of caution. It is only when the 
loadings go above approximately .30 that 
some importance can be attached to them. 











Table 2 
Factor Matrix 

Verbal 
Variable Intelli- Produc- Elab- Individ- 

gence tivity oration uality 
OSPE 67 03 —02 -03 
Total Words 50 34 10 06 
Adjectives 47 41 02 -03 
Verbs 39 32 39 05 
M 30 32 12 59 
R 10 96 01 00 
W % 33 -31 30 09 
=C 15 58 70 33 
A+Ad% 31 29 -13 -52 
Y 35 82 40 -01 
V 43 15 -03 58 





Four factors were obtained from a factor 
analysis of the correlational matrix, Table 2. 
The first factor has its highest loading on the 
OSPE with the next highest occurring on 
the verbal measures. The variables Y, V, M, 
and W% also have appreciable loadings on 
the first factor obtained. These are behavioral 
indicators which contribute to the loading of 
this factor but which should not do so accord- 
ing to Rorschach theory. The hypothesis 
might be ventured that the Rorschach deter- 
minants are not indicators of different be- 
havioral manifestations but rather a priori 
categories which have relatively little inde- 
pendence. Perhaps Y, VY, and M reflect the 
ability to verablize in a testing situation. If 
the subject cannot express himself verbally, it 
becomes almost impossible to score shading 
and vista determinants. Shading responses are 
supposed to indicate depression; but if the 
individual is depressed and refuses to verbal- 
ize, it is questionable whether or not he will 
produce Y responses. The first factor will be 
referred to as one of “Verbal Intelligence.” 
Since Y per cent and M do not have high 
loadings on this factor, it is questionable that 
they are adequate indicators of intelligence. 
This finding is in keeping with other studies 
[1] which have shown that little relationship, 
if any, exists between M and intelligence. 

The second factor extracted is interesting 
in view of the fact that some Rorschach 
workers feel that there is relatively high in- 
dependence of Rorschach determinants; this 
factor will be referred to as one of “Produc- 
tivity.” Variable R has by far the maximum 
loading which is followed by Y and Sum C. 
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One conclusion appearing warranted for the 
sample used in this study is that the more 
responses the subject gives, the greater the 
possibility of giving some form of color or 
shading responses. Similar results have been 
obtained by Wittenborn [9] and by Schroder 
[8]. Again we see that Rorschach determi- 
nants have much in common; such being the 
case, some of the Rorschach categories might 
profitably be deleted or combined. 

The third factor obtained is referred to as 
an “Elaboration” factor, that is the extent 
to which the individual can describe his 
specific perceptions. Color and shading appear 
to contribute a maximum to this factor. As 
with the previous factors we see that the color 
response is not a distinct category but is re- 
lated to the other determinants. “Anxiety” 
and “affect” should not appear correlated 
for a “normal” population to the extent that 
they do in this study as well as in that by 
Wittenborn. 

The last factor extracted is called an “In- 
dividuality” factor. Movement, vista, and 
color have high positive loadings while the 
animal percentage has a high negative loading. 
This factor agrees somewhat with Rorschach 
literature in that M and 4 are inversely re- 
lated. 


Summary 


Thirty undergraduate students were ad- 
ministered individual Rorschachs. The sub- 
jects also gave verbal descriptions of five 
hypothetical situations. Intercorrelations were 
obtained for some of the Rorschach scoring 
categories and three verbal descriptive scores. 


The correlations were then subjected to a 
factor analysis. The following four factors 
were obtained: “Verbal Intelligence,” “Pro- 
ductivity,” “Elaboration,” and “Individual- 
ity.” From the loadings on some of the factors, 
for the present sample, it appears that Ror- 
schach determinants are related to language 
measures. Specific Rorschach determinants are 
sometimes closely related to other determi- 
nants, in this matrix, although they previously 
have been considered relatively independent 
of the related variables. An analysis of the 
factors suggests that some revision is called 
for in the categories of Rorschach scores, and 
consequently the interpretations of these cate- 
gories. 
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The Effectiveness of Rorschach Elements in the 
Discrimination Between Neurotic and Am- 
bulatory Schizophrenic Subjects” 


Glenn W. Rieman 


Veterans Administration Hospital, Altoona, Pa. 


Since its introduction in 1921, the Rorschach 
test [18] has gained widespread use as a tech- 
nique for the understanding and interpretation 
of personality. Some clinicians have developed 
qualitative and quantitative signs to aid in the 
differential diagnosis between nosological 
groups. Miale and Harrower-Erickson [11] 
proposed nine “neurotic signs” to distinguish 
between neurotic and normal subjects. Ror- 
schach [1, p. 233] contended that certain signs 
were pathognomonic for schizophrenia. In a 
preliminary study, Harrower-Erickson [5, p. 
114] maintained that her signs might prove 
to be promising in discriminating between 
neurotics and psychotics. 


The purpose of this study was to determine 
whether there are statistically significant group 
differences between neurotic and ambulatory 
schizophrenic subjects with respect to certain 
Rorschach elements and signs. The investi- 
gation is actually a combination “element-inci- 
dence and sign” study since it involved both a 
preliminary search for group differences in 
specifically defined elements preparatory to the 


1This article is based upon a dissertation sub- 
mitted by the writer in partial fulfillment of the 
requirements for the Ph.D. degree, University of 
Pittsburgh, 1950. 


“Published with the permission of the Chicf 
Medical Director, Department of Medicine aud 
Surgery, Veterans Administration, who assumes no 
responsibility for the opinions expressed or conclu- 
sions drawn by the author. 


®The writer is indebted to Dr. Roy M. Hamlin, 
Chief Clinical Psychologist of the Western Psy- 
chiatric Institute and Clinic, University of Pitts- 
burgh, Pittsburgh, Pennsylvania, and formerly 
Chief Clinical Psychologist, Veterans Administra- 
tion Mental Hygiene Clinic, Pittsburgh, Pennsyl- 
vania, for a critical reading of this paper. 
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formulation of signs, as well as the employ- 
ment of signs previously utilized. The sign 
approach has been used since it is an objective 
technique which indicates the salient features 
in an individual’s personality structure with a 
minimum expenditure of time and effort. This 
type of investigation holds that the various 
components of the Rorschach test may be 
utilized singly or in combination, as contrasted 
with the intuitive or global approach alone. 

Piotrowski [14, 15, 16] described ten Ror- 
schach signs for the identification of patients 
with intracranial involvements. Twenty schiz- 
ophrenic signs were gleaned from the literature 
by Klopfer and Kelley [10]. Buhler, Buhler, 
and Lefever [2] devised a “Diagnostic Sign 
List” to aid in the establishment of diagnostic- 
sign patterns for different clinical groups. 
Ross [19] applied the sign techniques of Pio- 
trowski and of Miale and Harrower-Erickson. 
Davidson [4] reported a high correlation be- 
tween personality patterns of children as classi- 
fied by an othodox use of the Rorschach test 
and personal and social adiustment as ascer- 
tained by her objective Rorschach signs. Mun- 
roe [13] developed her Inspection Rorschach 
whereby the protocol may be scanned by means 
of an objective checklist in order to procure 
a general adjustment rating. To measure 
personality changes in persons undergoing psy- 
chotherapeutic treatment, Muench [12] em- 
ployed 22 Rorschach factors or patterns of 
adjustment. 


Subjects 
Neurotic and ambulatory schizophrenic sub- 
jects were chosen for this study because clini- 


cians frequently have difficulty in discrimina- 
ting between them diagnostically. The neurotic 
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and the schizophrenic groups were divided 
into two numerically equal subgroups by the 
odd-even method so that there were four re- 
search groups: 50 neurotics and 50 schizo- 
phrenics for the original investigation, 50 dif- 
ferent neurotics and 50 different schizophren- 
ics for the replication study. Each subject 
chosen had a service-connected disability for 
either neurosis or schizophrenia. Furthermore, 
the diagnosis must have been confirmed 
currently by a psychiatrist in the installation 
where the patient was seen for diagnosis, 
treatment, or both. 

It was impossible to determine whether a 
Rorschach test had been administered prior 
to the service-connected diagnosis and might 
have had some influence upon this diagnosis. 
It is recognized that most Veterans Adminis- 
tration installations do employ the Rorschach 
test almost routinely and that such results are 
utilized by many psychiatrists in arriving at 
a diagnosis. Complete control over this vari- 
able was not feasible within the scope of this 
study. Presumably, a patient would not be 
placed in either diagnostic category without 
one diagnosis little influenced or uninfluenced 
by Rorschach results. In practice, diagnoses 
continuing over a period of time are based 
primarily upon clinical behavior rather than 
upon test results. 

Each neurotic subject had been interviewed 
on an outpatient basis at the Veterans Admin- 
istration Mental Hygiene Clinic, Pittsburgh, 
Pennsylvania. Forty-four of the schizophrenic 
subjects were chosen from the same installa- 
tion; 42 had been seen at the Veterans Ad- 
ministration Mental Hygiene Clinic, Newark, 
New Jersey; and 14 were selected from the 
neuropsychiatric wards of the Veterans Ad- 
ministration general hospitals at Aspinwall, 
Pennsylvania, and Butler, Pennsylvania.* The 
ambulatory schizophrenic subjects used were 
individuals who still maintained some contact 
with reality and had not deteriorated to the 

Appreciation is extended to the Veterans Ad- 
ministration clinical psychologists who made avail- 
able their psychological files and records for the 
accumulation and analysis of data. They are: Dr. 
David Cohen, Deshon Hospital, Butler, Pennsyl- 
vania; Dr. Howard W. Goodman, Aspinwall Hos- 
pital, Aspinwall, Pennsylvania; Dr. Roy M. Ham- 
lin, Mental Hygiene Clinic, Pittsburgh, Pennsylva- 


nia; and Dr. Samuel B. Kutash, Mental Hygiene 
Clinic, Newark, New Jersey. 


extent that constant hospitalization was indi- 
cated. 

Only male, white, veterans of World War 
II were used. The schizophrenic subjects from 
the Pittsburgh and Newark areas were amal- 
gamated in a random fashion; there was no 
significant difference between the original and 
the replication studies with respect to the 
number of Pittsburgh and non-Pittsburgh 
cases involved. The two nosological groups 
were equated on the basis of age, intelligence, 
and education. Ages ranged from 19 through 
38. Educational levels varied from the sixth 
grade through one year of graduate school. 
Full-Scale Wechsler-Believue Intelligence 
Quotients ranged from 78 through 135. The 
compared groups were not at all significantly 
different with respect to age, intelligence, and 
education. 

Procedure 


Certain factors, ratios, patterns, and signs, 
designated as elements, had been compiled 
previously into a Rorschach Element List® 
composed of 86 items. Many of the elements 
tested are not signs in the strict sense of the 
word. A number of them are simply the vari- 
ous location, determinant, and content factors 
as used by Hertz [6] and Klopfer and Kelley 
[10]. Some are percentages, ratios, differences, 
and combinations of factors extracted from 
sign lists and techniques employed by Muench 
[12], and Klopfer and Davidson [9]. Some 
are qualitative characteristics which have been 
defined quantitatively and checked to indicate 
their presence. Still others are signs, in the 
accepted sense, which have been adopted or 
adapted from devices utilized by Harrower- 
Erickson [5], Buhler, et al [2], and Piotrow- 
ski [14, 15, 16]. 

Each Rorschach protocol was scored by the 
investigator from the original verbatim copy 
according to a prescribed procedure which may 
be described as a modified Klopfer system. 
Form accuracy, location, and populars were 
checked against Hertz’s Tables [6]. In order 
to check the accuracy of the scoring, a 
sampling of the records was rescored inde- 
pendently by another experienced Rorschach 


5The descriptive definitions of the elements used 
can be found in the unpublished doctoral disserta- 
tion of the writer [17] on file in the University of 
Pittsburgh library. 
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worker, using the same scoring guides, after 
which a percentage of agreement was calcu- 
lated. Upon completion of the scoring process, 
the items on the Element List were tabulated 
for each individual record and these tabula- 
tions were amalgamated for the nosological 
groups under consideration. The 86 Rorschach 
elements were as follows: 


I. Scoring Factors 


weighted 
57. [FC — (CF + C)] weighted 
58. Fk + FK + Fe + FC’ 
59. F : (Fk+ FK + Fe + FC’) 
60. M + FC — (CF + C) 
61. M — FM 
62. H — Hd 
63. Sum C (weighted) 
64. M : Sum C (weighted) 


V. Pathological Signs (Check presence) 
65. Perseveration 


66. 
67. 
68. 
69. 
70. 
71. 
72. 
73. 


Impotence 

Perplexity 

Automatic phrases 

Color naming 

Shading shock 

Color shock 

Description 

Significant comments 

. Abstraction and symbolism 


. Confabulation 


. Contamination 

. Sex confusion or unusual handling 
. Position 

. Turning 

. Edging 

. Self-reference 

. Pathological verbalization 


1. W 20. ¢ 
2. D 21. FC’ 
3. Dr 22. C’F 
4. § 23. C’ 
5. Do (oligophrenic) 24. FC 
6. M 25. CF 
7. M+ 26. C 
8. FM 27. P (popular) 
9. m (Fm, mF, m) 28. O (original) 
10. Fk 29. H 
11. kF 30. Hd 
12. k 31. A 
13. K 32. Ad 
14. KF 33. At 
15. FK 34. Sex 
16. F+ 35. Ar (artificial) 
17. F— 36. Na (natural) 
18. Fe 37. Pathognomonic 
19. cF content 
38. Pathological 
content 


II. Responses and Timing 
39. R (number of responses) 
40. T/R (average time per response) 
41. Reaction time to cards without color (I, IV, 


V, VI, VII) 

42. Reaction time to cards with color (II, III, 
VIII, IX, X) 

43. Per cent responses to color (responses to 
VIII, IX, X) 


44. Per cent responses to shading (responses to 
IV, VI, VII) 


III. Form-Level Rating (FLR) 
45. Total 
46. Average per response 
47. Average per response (noncolor) 
48. Average per response (color) 


IV. Patterns and Ratios 
49. F% 
50. F + % 
51. FM + total m : Fc + total c + total C’ 
52. A (A + Ad) % 
53.H +A:Hd+ Ad 
54.W:M 
55.R+ % 
56. [((Fk + FK + Fe + 

KF+K+ F+c 


FC’) — (AF +k + 
C’F + C’)] 


VI. Miscellaneous 
84. “Ww” 


85. Rejections or failures (I through X) 
86. Succession 


Chi square and its probability values were 
utilized as the statistical tools for a test of 
significance of the difference between the two 
groups with respect to each element on the 
Rorschach Element List. In order to exercise 
some control over the possible influence of the 
subject’s number of responses (R) upon cer- 
tain category scores, two precautions were 
taken. First, the usual method of converting 
raw scores into percentages by dividing by R 
was employed where applicable. Secondly, an 
adaptation of a method advocated by Cron- 
bach [3] was utilized to aid in partialling out 
differences in R. Each nosological group was 
divided at the approximate median of the R 
into two subgroups labeled “Brief” and 
“Longer” for separate tests of significance. If 
the » values for these two subgroups differed 
by less than 0.25 on each element, the “Brief” 
and “Longer” subgroups were ignored and 
only the “total” chi square and p value for 
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the element was considered. However, if the 
p values for these two subgroups differed by 
0.25 or more, each “Brief” and “Longer” 
subgroup was tested separately by chi square 
for significant differences. In order to obtain 
a 2X2 table for the application of chi square, 
each element or element subgroup was dicho- 
tomized as near as possible to the median ob- 
tained by inspection. Elements scored for 
presence alone were dichotomized on the basis 
of presence or absence. Yates’s correction for 
continuity [7] was used with all elements ex- 
cept one. Another correction was made for the 
few elements the cell frequencies of which 
were less than five. Because of small cell fre- 
quencies, several elements with similar theo- 
retical meanings were combined ; a few others 
could not be treated statistically for the same 
reason. 

Since Rorschach factors are known to vary 
from one sample to another, further confirma- 
tion of the results of the original study was 
considered worth while. Those elements which 
revealed differences between groups at the 10 
per cent level of confidence or better were 
singled out for additional study. The 10 per 
cent level was chosen as the cut-off point to 
allow for the inclusion and investigation of 
borderline factors. Those elements were re- 
tested on another sample of identical size em- 
ploying the same techniques used in the origi- 
nal investigation. 

Certain limitations of this investigation are 
recognized quite frankly. A major problem in 
dealing with nosological groups is diagnosis, 
especially where there is an overlapping of 
symptoms as in the case of neurotics and 
ambulatory schizophrenics. The accuracy and 
consistency of psychiatric diagnoses have been 
questioned frequently. In this study, incon- 
sistencies of diagnosis were kept to a minimum 
by two procedures: (a) the selection of sub- 
jects was dependent upon two diagnostic judg- 
ments per individual with a time lapse between 
diagnoses; and (4) psychiatric diagnosis in 
both the armed forces and the Veterans Ad- 
ministration employs a well-standardized, tabu- 
lated, and similar plan. A second limitation 
lies in the problem of the homogeneity of the 
nosological groups under consideration since 
all neurotic subjects were selected from one 
mental hygiene clinic whereas the schizophren- 


ics were chosen from three other installations 
in addition to the one just mentioned. How- 
ever, both clinics are conducted under similarly 
oriented psychiatrists. Moreover, since deter- 
iorated schizophrenics are not assigned per- 
manently to the two hospitals, it would appear 
permissible to include schizophrenic patients 
from these hospitals under the general classi- 
fication of ambulatory schizophrenics. A third 
limitation centers in the applicability of the 
findings. This study is concerned with groups, 
and any conclusions derived therefrom are ap- 
plicable to similar groups alone, in the strictest 
interpretation. Individuals are the primary 
concern of clinicians. However, many persons 
feel that group results may serve as a base of 
operations for use in individual cases. 


Results 


With respect to the major scoring categories, 
the percentages of agreement on the scoring 
accuracy check are as follows: location, 90; 
determinants excluding form quality, 87 ; form 
quality of determinants, 88 ; content, 92 ; popu- 
lars, 82; and originals, 33. 


Table 1 
Elements Showing Significant Group Differences 
on Both Original Investigation and 
Replication Study 











Replica- 
Original tion Group 
Element investigation study exceeding 
chi chi on element 
square p square p specified 
Ave. 
FLR 7.844 .002 9.000 .005 Neurotic 
Ave. 
FLR 4.000 .05 4.910 .03 Neurotic 
(non- 
color) 
R+% 7.844 .007 5.762 .02 Neurotic 
Persevera- 
tion 3.646 .06 5.018 .03 Schizophrenic 
Confabu- 
lation 6498 .01 4.158 .04 Schizophrenic 
Pathologi- 
cal Ver- 
baliza- 
tion 8.678 .006 8.384 .006 Schizophrenic 





According to the established criterion, 
twenty elements are influenced by the number 
of R. Only 19 of the 79 elements finally tested 
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out in this investigation show significant dif- 
ferences at the 10 per cent level or better be- 
tween the neurotic and the ambulatory schiz- 
ophrenic groups. They are: § (Brief); M% 
(Longer); FC’'% (Longer); P% (Total) ; 
H% (Longer); T/R; RT, Color; Average 
FLR; Average FLR, Noncolor; Average 
FLR, Color; Succession; F+%; W: M 
(Longer); R + % ; Fk + FK + Fe + FC’ 
(Longer); Perseveration; Shading Shock; 
Confabulation; and Pathological Verbaliza- 
tion. 

The six elements which revealed significant 
group differences at the 10 per cent level of 
confidence or better on both the original in- 
vestigation and the replication study are listed 
in Table 1. 

The possibility that the diagnostic groups 
were contaminated by the use of the Rorschach 
in their diagnosis is a justifiable criticism and 
can be answered finally only by further re- 
search. A strong case can be made for the 
assumption that the clinical use of the Ror- 
schach is not influenced to a major degree by 
the six items in the specific positive results. 


Table 2 


Schizophrenic Signs 








Average Form-Level Rating < 0.84 
Average Form-Level Rating (noncolor) < 0.93 
R + per cent < 82 

Perseveration Present 
Confabulation Present 
Pathological Verbalization* Present 





*As defined in this study, an element which includes 
comments and responses that appear queer and peculiar, 
bizarre, incoherent and vague, illogical and absurd, erit- 
ical or aggressive, self-depreciatory, irrelevant, morbid to 
an excessive degree, or neologistic. 


While Contamination and Position did not 
show significant group differences on the origi- 
nal investigation but did so on the replication 
study, their comparative frequencies suggest 
that the presence of either type of response is 
practically pathognomonic for schizophrenia. 

The six statistically significant elements 
tabulated in Table 1 were converted into the 
“schizophrenic signs” listed in Table 2 by 
means of cut-off points at the inspectional 
median in the case of the first three listed, 
while presence alone was considered a sign in 
the case of the last three listed. The total 


Table 3 


Distribution of Schizophrenic Signs Shown by 
Subjects in Each Nosological Group 








Total signs per 





. Neurotic Schizophrenic 
subject 
6 0 3 
5 1 15 
4 10 18 
3 18 29 
2 8 il 
1 23 13 
0 40 11 
N= 100 N = 100 





number of these signs for each of the individ- 
ual schizophrenic and neurotic cases used in 
both studies was determined. These results 
are presented in Table 3. By means of chi 
square, it was determined that ambulatory 
schizophrenics reveal a higher number of these 
six diagnostic signs, statistically significant at 
the .001 level of confidence, than do neurotics. 
If the presence of any three of these six diag- 
nostic signs were chosen arbitrarily as the cut- 
off point for a differential diagnosis between 
neurosis and schizophrenia on an individual 
basis, 65 per cent of the schizophrenics would 
have been identified properly. However, 29 
per cent of the neurotics would have been in- 
cluded falsely within the schizophrenic classi- 
fication. If five signs were selected as the cut- 
off point, a mere 1 per cent of the neurotics 
would have been categorized mistakenly but 
only 18 per cent of the schizophrenics would 
have been identified. Such results may have 
some value for group purposes but probably 
embody too much inaccuracy for individual 
differentiation. 


Summary and Conclusions 


1. Neurotics and ambulatory schizophrenics 
as groups do not show significant differences 
in the great majority of the Rorschach ele- 
ments treated. Finer tools within the elements 
themselves might prove more productive. 

2. Five elements showed significant group 
differences at the 5 per cent level of confi- 
dence on both samples. They are: Average 
Form-Level Rating, Average Form-Level 
Rating (noncolor), R+per cent, Confabula- 
tion, and Pathological Verbalization. Per- 
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severation has been retained as significant even 
though it did not quite meet the above-men- 
tioned standard on one of the two samples. 

3. This research indicates the value of a rep- 
lication study in testing Rorschach factors. 

4. A worth-while by-product of this study 
is the demonstration that two trained individ- 
uals working independently with identical 
scoring guides agree to a large extent in the 
scoring of Rorschach responses. 

5. Several observations may be made with 
respect to the theoretical meanings of the ele- 
ments showing significant differences between 
the two diagnostic groups. The neurotic 
groups have more capacity to perceive com- 
monly seen concepts and are better able to 
organize and elaborate accurately than the 
schizophrenic groups. The schizophrenic 
groups are more inclined to have difficulty in 
shifting their thought trends, to be unduly 
elaborative in an unrealistic manner, and to 
indulge in bizarre and illogical reasoning. 

6. Kendig’s “Principle of distortion of 
reality’ [8] as crucial in the diagnosis of 
schizophrenia has been at least partially sub- 
stantiated by the present study. These schizo- 
phrenic groups do tend to confabulate, to 
perseverate, to verbalize peculiarly, to perceive 
in an unusual fashion, and to be inaccurate in 
organizational and elaborative capacity more 
frequently than the neurotic groups. 

7. Diagnostic “schizophrenic signs” obtained 
from the statistically significant elements may 
be useful for group differential purposes but 
are probably too inaccurate for individual 
diagnostic discrimination. It may be that these 
two groups are too ill defined as diagnostic 
categories to offer hope of a clear-cut differ- 
entiation between them by means of Rorschach 
signs. 

8. Although the results of this study are 
predominantly negative, one observation should 
be made. Since the two nosological groups 
employed overlap in symptomatology, results 
which are only moderately positive or indica- 
tive of a trend are actually more significant 
than are apparently better results with more 
divergent groups. 

9. It is highly improbable that the positive 
results obtained can be adequately explained 
by the possibility that the criterion groups may 
have been contaminated by the utilization of 


the Rorschach in their diagnosis. However, 
additional research is needed to verify this con- 
tention. 

10. The comparative efficiency of this Ror- 
schach sign technique and the global approach 
in the diagnostic differentiation of these two 
nosological groups might be worthy of study. 
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Productivity on the Rorschach as a Function 
of Order of Presentation 
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University of Kentucky 


Increased productivity in the all-color cards 
(Figs. VIII, LX, X) is expected on the theory 
that color has a stimulating effect upon affec- 
tively labile individuals. Rorschach himself 
believed that there was a relationship between 
the number of responses influenced by color 
and the extent of emotional excitement al- 
though he states, ““The causes of this corre- 
lation remain to be discovered” [8, p. 98]. 


A study reported by Dubrovner [4] in 
which he compared the effects of standard 
versus achromatic plates revealed no signifi- 
cant shifts in productivity upon retesting. ‘The 
“color cards” (Figs. VIII-X) produced more 
responses than the “noncolor cards” (Figs. 
I-VII) regardless of the presence or absence 
of color. In view of this it becomes tenuous 
to assume that color alone is responsible for 
increased productivity in the last three cards. 

In order to provide for controlled compari- 
sons, retesting of the same subjects under 
different conditions has been deemed necessa- 
ry. Rabin and Sanderson [7] retested their 
subjects with both standard and reversed 
orders of presentation and upon retesting 
found an increase in stereotypy (4%), reduc- 
tion of productivity in the reverse order con- 
dition, and a reduction of “shock” in the re- 
test irrespective of which order was first pre- 
sented. It appears that with the novelty of the 
Rorschach situation somewhat eliminated in 


1This study was done in partial fulfillment of re- 
quirements for an M.S. degree in psychology. The 
writer wishes to express his sincere appreciation for 
the indispensable guidance and suggestions of Dr. 
Richard M. Griffith and Dr. Robert D. North, his 
counselors and friends. Grateful acknowledgment is 
also made to the student nurses of Good Samaritan 
Hospital, Lexington, Kentucky, who, in providing 
the data for this experiment, graciously gave of 
their time. 
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all but the first acquaintance with the test, 
comparisons between test and retest data 
are incongruous. 

Schachtel [9] believes that both reaction 
time and productivity are affected by the 
testee’s fears, attitudes, and interests which 
are activated by the testing situation. It seems 
that memory factors would strongly influence 
the subject’s definition of the retest situation 
for the challenge of the now familiar and no 
longer enigmatic plates is dispelled. 


A common clinical observation is that the 
initial interview situation tends to be less pro- 
ductive than later ones. The subject finds 
himself in a novel relationship which, with 
the establishment of rapport, becomes decreas- 
ingly disturbing to him as a frame of refer- 
ence is gradually established. In the unstruc- 
tured Rorschach situation, the phenomenon is 
doubly significant. In empirically determining 
the order of the plates within the series, Ror- 
schach predicted that failure on the first plate 
would rarely be encountered [8, p. 16]. He 
realized that early-appearing hesitancy and 
evasiveness could be alleviated by a relatively 
simple introductory stimulus card. Initial re- 
straint and anticipatory anxiety would dis- 
appear as adaptation to the task developed. 


In using the latin square, this present study 
is designed to circumvent the artifacts which 
arise by retesting the same subjects under dif- 
ferent conditions. Its specific purpose is to in- 
vestigate the possibility that irrespective of 
the sequential positions of the cards, later- 
appearing cards will produce more responses 
than earlier cards. At the same time, this de- 
sign permits an evaluation of the produc- 
tivity attributable to the cards themselves, in- 
dependent of their order of appearance. 
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Procedure 


From a female nurses training school, a 
group of 22 volunteers were obtained. Their 
ages ranged from 17 to 28 years with a mean 
chronological age of 20.2 years. Of the 22 
subjects tested, 2 were omitted because of ex- 
treme overproductivity of autistic quality. In 
such a study dealing with a limited number of 
subjects, variant scores offer a definite proced- 
ural problem. Dangers of bias in omitting data 
must be balanced with dangers of including 
discrepant data which would prevent later 
generalization to other defined and homo- 
geneous groups. Rorschach authorities have 
indicated that the response totals for normal 
subjects rarely exceed fifty [1, 6, 8]. The 
response totals for the two subjects excluded 
were 115 and 143 respectively — both con- 
siderably more than twice as large as the next 
highest score of 49 responses. 


In the latin-square design as used here, 
systematically randomized standard Rorschach 
plates were presented to each subject [5, 
p. 302]. Ten distinct sequential orders were 
arranged in which each card preceded and 
followed every other card just once [3]. This 
arrangement may be made more apparent by 
examination of Table 1 in which each card 
appears once in each column and once in each 
row. In this square, any systematic influence 
resulting from the positional or sequential 
effect of the color cards would thus tend to 
be minimized. 


To each of these discrete orders, a subject 
was randomly assigned and presented with the 
plates peculiar to that order. The same latin 
square was replicated by the random assign- 


ment of an additional subject to each of the 
ten orders of presentation. In this manner, 
twenty different subjects responded to ten 
dissimilar orders of presentation. 

The instructions to the subjects were those 
suggested by Beck [2, p. 2]. After having 
given two or more associations for a figure, 
any declaration by the subject that she was 
through with it was accepted. Encourage- 
ment took place when less than two responses 
per figure were obtained but was progressive- 
ly reduced until it was entirely discontinued 


after the fifth card. 


Results 


Before the data from the two separate 
latin squares were combined, they were tested 
for homogeneity of total variance by means 
of Bartlett’s test [5, p. 195]. The resulting 
chi-square value of .683 was not significant 
and offered no evidence against the hypothesis 
of random sampling from a common popula- 
tion. 


In comparing the data of the separate latin 
squares, homogeneity of variance was also es- 
tablished for the residual mean square and the 
sequential position mean square. The F values 
obtained were 1.04 and 1.16 respectively, 
which were not significant at the 5 per cent 
level. 


After combining the data from the separate 
latin squares it was further ascertained that 
differences in productivity between the se- 
quences or paifs ‘of subjects responding to one 
particular order in the latin square were not 
significantly different. Examination of the 
agreement between the samples as shown in 











Table 1 
Latin-Square Design of the Order of Presentation of the Rorschach Plates 
Positions 

Orders 1 2 3 4 5 6 7 8 9 10 
i I II Ill IV v VI Vil Vill Ix x 
Ss conn ~— II IV VI Vill x I Ill Vv Vil Ix 
See Ill VI Ix I IV VII x II Vv VIII 
© nase IV Vill I V Ix II VI x Ill VII 
Ct x IV Ix Ill Vill II vil I VI 
© * antaiemes VI I Vil II Vill III Ix IV x Vv 
, —aa San III x VI II Ix Vv I VIII IV 
0 atinccntie ** Vas V II x Vil IV I Ix VI Ill 
Be ecieed . e VII V Ill I x Vill VI IV II 
OE ‘ x Ix Vill VII VI V IV II! II I 
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Table 2 


Sums of Responses for Orders of Sequential 
Presentation (Note Table 1) 























Order of 
Presentation Sample 1 Sample 2 Total 
1 34 43 77 
2 18 29 47 
3 31 40 71 
4 33 22 55 
5 21 23 4a 
6 24 26 50 
7 49 23 72 
8 25 27 52 
9 15 23 38 
10 21 37 58 
Table 3 
Analysis of Variance Results 
sg. S. df M.S. F 
Independent 
observations: 
Order of 
presentation 76.32 9 8.48 1.20 (not sig.) 
Residual between 
individuals 
(error) 70.60 10 7.06 
Total between 
individuals 146.92 19 
Correlated 
observations: 
Cards 35.32 9 3.92 4.45** 
Positions 43.52 9 4.84 5.48°* 
Residual from 
latin square 78.36 72 1.09 1.23 (not sig.) 


Residual within 


individuals 79.40 90 88 
Total within 

individuals 236.60 180 
Total 383.52 199 


sponses by positions against the residual mean 
square within individuals, it was found that 
the obtained value of F (5.48) was highly 
significant for 9 and 90 degrees of freedom 
(Table 3). 











**Significant at 1 per cent level. 


Table 2 and the insignificant F value of 1.20 
in Table 3 demonstrate this fact. 

Table 4 reveals that the productiveness of 
these 20 subjects is apparently greater in the 
later sequential positions. The mean number 
of responses in the first seven positions was 
51.1 while that of the last three positions was 
68.7. A t value calculated for the difference 
between these means was 4.00, which was 
significant at the 1 per cent level. Testing the 
significance of the mean square for total re- 





Table 4 
Aggregate Sums of Responses by Positions 
Positions Responses Positions Responses 
1 52 6 48 
2 46 7 59 
3 51 8 63 
+ 48 9 66 
5 54 10 77 





The other factor of interest was the effect 
of the cards themselves. When tested for sig- 
nificance against the residual mean square, the 
mean square for cards was also found to be 
highly significant with an F value of 4.45 
(Table 3). 

Further analysis of the effect of color upon 
productivity demonstrated that when the 
number of responses of the color cards (Fig. 
II, 111, VIII, 1X, X) was compared to those 
of the completely achromatic cards (Fig. I, 
IV, V, VI, VII), the difference between the 
means (¢= 1.80) was not significant. When 
the number of responses to Figures I-VII was 
compared to those to figures VIII-X, the 
difference between the means was significant 
(t= 2.12) at the 5 per cent level. Examina- 
tion of Table 5 shows that Card X, in con- 
trast to Cards VIII and IX, is by far the 
most provocative of the series. Since Cards 
VIII and IX are also completely chromatic 


Table 5 


Aggregate Sums of Responses by Cards 
in All Possible Positions 











Cards Responses Cards Responses 
I 47 VI 57 
II 55 Vil 58 
Ill 55 VIII 53 
IV 53 Ix 59 
V 48 x 79 





and did not elicit any noticeable increment 
in productivity, it appears that the configura- 
tion of Card X may be the crucial factor facil- 
itating the subjects’ responsiveness. 
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Summary and Conclusions 

The data used in this experiment were ob- 
tained from 20 of 22 Rorschach-naive student 
nurses. The 2 subjects were discarded because 
of their extreme overproductivity. The 20 
subjects were presented with ten distinct 
systematically randomized sequential orders 
of standard Rorschach plates in a latin-square 
design. In this manner each plate appeared 
in all positions and preceded and followed 
every other plate an equal number of times. 
Within the limitations isnposed by the homo- 
geneity of the sample used, examination and 
statistical analysis of the data revealed that: 


1. Irrespective of the order of the cards, the 
position of the cards is of importance with 
later-appearing cards producing more re- 
sponses than earlier-appearing cards. 

2. Irrespective of their orders of presenta- 
tion or their sequential relationships, the cards 
themselves differ in the number of responses 
elicited with Card X, because of its color or 
configuration, or both, evoking more responses 
than any other. 

Thus, it is shown that the positional effect, 
quite apart from color, could account for in- 
creased productivity in later-appearing cards. 
While made suspect, it is not definitely shown 
that color does not also have some effect. The 
present writer expects to isolate this factor by 
the presentation of achromatic plates in the 


same latin-square design. If similar results are 
obtained in this follow-up study, it will pro- 
vide conclusive evidence that the configuration 
of the plates and the order of their presenta- 
tion are the factors responsible for increased 
productivity in the later-appearing cards. 
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A technique called “An Index of Adjust- 
ment and Values” which is designed to give 
measures of the concept of self, acceptance of 
self, the concept of the ideal self, and malad- 
justment has been reported by Bills, Vance, 
and McLean [2]. Additional studies by Rob- 
erts [6] and Bills [3] have confirmed fur- 
ther the reliability and validity of the Index 
scores. 

The present study is concerned with one 
of the four measures of the Index—acceptance 
of self. Studies by Seeman [8], Snyder [10], 
Sheerer [9], and Stock [11], have established 
that during successful psychotherapy there is 
an increase in positive attitude toward self or 
acceptance of self. Since acceptance of self has 
been considered a central personality variable, 
it follows that people who are high in accept- 
ance of self should differ, in general, in their 
personality characteristics from people who are 
low in acceptance of self. 

‘rhe Rorschach test [1, 4, 7] purports to 
give a description of an individual’s person- 
ality. If persons who are high in acceptance of 
self differ in personality characteristics from 
people who are low in acceptance of self, and 
if the Rorschach is able to differentiate per- 
sonality characteristics, then persons who are 
high in acceptance of self should have Ror- 
schach test results which differentiate them 
as a group from persons who are low in ac- 
ceptance of self. 


Design 


Twenty volunteers, female students at the 
University of Kentucky, were tested with the 


1This study was made possible by a grant from 
the University of Kentucky Research Fund Com- 
mittee. The author is deeply appreciative for this 
aid. The author would also like to express his 
thanks to Glen E. Roberts who worked as an assist- 
ant on the project. 


Index of Adjustment and Values and the Ror- 
schach test. This pilot group was divided into 
two groups on the basis of acceptance-of-self 
scores above and below the mean score of the 
group on which the Index was standardized. 
The division placed 15 subjects who had scores 
below the mean of acceptance of self in one 
group and 5 subjects who had scores above 
the mean of acceptance of self in the other 
group. A comparison of the Rorschach re- 
sults for the two groups suggested the hypoth- 
eses listed in Table 1. 


A second group of 50 volunteer students 
was obtained by using as the criterion of se- 
lection, scores on acceptance of self as meas- 
ured by the Index of Adjustment and Values. 
Twenty-five of the subjects had scores which 
were in excess of one standard deviation above 
the mean acceptance-of-self score of the stand- 
ardization population of the Index (this group 
will be referred to as the “high scorers’) and 
twenty-five of the subjects (“low scorers’) 
had scores more than one standard deviation 
below the mean acceptance-of-self score of the 
standardization population. The two groups 
were balanced for sex and Kentucky General 
Classification Test scores. Each group con- 
sisted of 8 male and 17 female subjects, and 
a test of the significance of the difference be- 
tween the means of the scores of the two 
groups on the Kentucky General Classifica- 
tion Test gave a ¢t of .750 which showed that 
at the .60 level the groups were not significant- 
ly different in general ability. The groups were 
not significantly different.in respect to the 
number of responses on the Rorschach, as may 
be seen in Table 1. 


Each of the 50 experimental subjects was 
tested with the Rorschach, using Beck’s in- 
structions [1], by an examiner who had no 
knowledge of the hypotheses under investiga- 
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Table 1 


The Hypotheses of the Study and the 


Statistical Results 








: 3 Chi 
Variable Hypothesis oquare , 
M:Sum C Above Sum C>M _ 14.346 .001 

Below M>Sur: C 
F+% Above F+% lower 35.280 .001 
than below 
FC Above less FC 9.680 .01 
CF Above more CF 27.000 .001 
CF:FC Above CF>FC 38.782 .001 
Below FC>CF 
Sequence Above fewer cards n.s. 
in sequence 
A% No difference in n.s 
two groups 
F% No difference n.s 
R No difference n.s 
FC'* No difference 2.080 .20 
M Above less M 2.000 .20 
Maps, etc. Above more evasive 2255 *® 
(evasion) 
A+H: Above <2 wholeto 3.125 .08 
Ad+Hd 1 part. Below >23 
whole to 1 part. 
P Above more P 4.023 .05 
%R ViUll-X % smaller in 8.013 01 
above group 
RT Chromatic No difference n.s. 
RT Achromatic No difference D.s. 
RT Dif. Chr. Above greater 2.922 .10 
and Ach. difference 
W:M Above W>2M 4.667 .05 
Below W<2M 
TIR Above react quicker 3.945 .05 
No. Turns Above fewer turns 2.885 .10 
No. Cards Above turn fewer 2.000 .20 
Turned cards 
M:FM FM>M in above 8.323 01 
FM <M in below 
Defenset Above more defensive 2.885 .10 
H% No difference n.s. 
c:kt No difference n.s. 
WT Above larger W% n.s. 
Obj. No difference n.s. 
N No difference n.s. 
Fire,etc. No difference n.s. 
(aggression) 
(H) Below more (H) n.s. 
Fm|| Above more Fm n.s. 








*Includes FO’, 0’, and O’F. 

tIncludes Fc, c, cF, k, kF, Fk, K, KF, and FK. 
tRatio of Fe +c+cF tok +k? + Fk + K + KF + FE, 
|Includes Fm, m, and mF. 


tion. The Rorschachs were then scored by a 
second person, not the Rorschach examiner, 


who had no knowledge of the subjects’ classifi- 
cation on the Index of Adjustment and Val- 
ues. The scoring system used was a mixture 
of Beck [1], Klopfer and Kelley [4], and 
Krugman [5]. Beck’s system was used to score 
populars and location, and to determine form 
level. In the determination of F+% Beck's 
tables were used to determine form level, and 
F+9% was calculated from the formula: Good 
F divided by Rorschach F. Rorschach F is the 
total number of determinants minus the color 
and human movement responses. All other 
scoring was from Klopfer and Kelley except 
as noted at the bottom of Table 1. 


The records of two of the “high scorers” 
and two of the “low scorers” were selected at 
random and scored by two judges working 
independently of each other.? Neither of the 
judges was acquainted with the basis of selec- 
tion of the subjects nor the hypotheses being 
tested. Percentages of agreement between the 
Rorschach scorer and the two judges were 
calculated for each of the four cases for the 
location, determinant, content, and “popular” 
categories. The percentages ranged from 76 
to 100, and 23 of the 32 percentages were 90 
per cent or greater. 


Results 


Table 1 presents the Rorschach variables 
investigated, the predicted direction of the 
differences of the high scorers and low scorers, 
and the chi squares and probabilities resulting 
from the calculations from double dichotomous 
tabulations. In these tabulations one dichot- 
omy was formed by the independent variable, 
acceptance of self, and the other dichotomy 
by the division indicated in the prediction, or 
where no definite prediction was made con- 
cerning the dividing point, at the median score 
of all 50 cases. 


Discussion 


The data show striking differences in the 
two experimental groups. Only two of the 
low scorers had F+9%’s less than the median 
of all 50 cases, and only two of the high scor- 
ers had F+%’s greater than the median. It 
may be concluded, therefore, that the high 


2The author is appreciative of the assistance giv- 
en by O. S. McLean and R. C. Nichols, who served 
as the judges. 
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scorers and low scorers are distinctly different 
in respect to F+%. 

The number of human movement responses 
was not significantly different in the two 
groups, although the difference approached 
statistical significance. A comparison of the 
number of human movement responses with 
the weighted color sum, however, shows an- 
other striking difference—the experience bal- 
ances of the two groups are reversed. T'wenty- 
two of the high scorers showed the suin of 
the weighted color responses greater than the 
number of M and one case had M equal to 
the sum of the weighted color responses, 
whereas, 16 of the 25 low scorers had the num- 
ber of M greater than the sum of the weighted 
color responses. This finding leads to the con- 
clusion that the high scorers are extratensive in 
their experience balance while the low scorers 
are introversive. 


Tk« aigh scorers and low scorers differed 
significantly in the type and number of color 
responses. The low scorers used fewer color 
responses but more ‘‘well-controlied” color 
represented by FC, whereas the high scorers 
used a greater number of color responses and 
more “poorly controlled” color represented by 
a predominance of CF and C responses. No 
“pure C” appeared in the records of the low 
scorers, but 14 of the 25 high scorers showed 
at least one pure C response. Furthermore, the 
high scorers showed an excess of CF over FC, 
and the low scorers an excess of FC over CF. 
Of the 25 high scorers, 24 had more CF than 
FC responses, but 23 of the low scorers had 
more FC than CF. It is concluded, therefore, 
that if the type and number of color responses 
is representative of affective life, then the high 
scorers have a stronger and less well-controlled 
affect than the low scorers. 

Other variables including number of popu- 
lars, the percentage of responses on the last 
three cards, the W:M ratio, the time per re- 
sponse, and the 17: FM ratio show that at the 
-O5 level of significance, or better, that the 
two groups are clearly different. 


It is apparent, therefore, that in respect to 
certain important personality characteristics 
the high and low scorers, as measured by the 
Rorschach, constitute two distinctly different 


personality groups. Thus, it is concluded that 
the Index of Adjustment and Values is able 
to separate groups with different personality 
characteristics. 


Summary 


On the basis of a pilot study, 34 specific 
hypotheses were formulated relative to Ror- 
schach variables present in the personalities of 
persons high and low in acceptance of self as 
revealed by the Index of Adjustment and Val- 
ves. Fifty new subjects with extreme accept- 
ance of self scores were examined with the 
Rorschach test. Of the 34 hypotheses 23 were 
confirmed, 4 were denied, and 7 remain in 


doubt. 

It was concluded that distinct Rorschach 
personality characteristics distinguish subjects 
who are high in acceptance of self from those 
who are low in acceptance of self. 
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One of the most widely accepted beliefs 
among psychologists today is that discrepancy 
between the self concept and objective reality 
is a common feature of maladjustment. Such 
discrepancies are said to represent a lack of 
insight, and a major goal of psychotherapy is 
to help the individual reorganize his self con- 
cept so that it will correspond more adequate- 
ly with the self as viewed by others. Granted 
that in general the above statement may be 
true, it does not follow, without further ex- 
perimental verification, that the relationship 
between such discrepancies and severity of 
maladjustment is as simple and direct as is 
often assumed. The present study was under- 
taken to examine the nature of this relation- 
ship in several groups of college men. 


Description of the Study 


Population. The population consisted of 79 
male students, all the members of four fra- 
ternities, A, B, C, and D, who were residing 
in their respective fraternity houses at the 
time. Each subject was well acquainted with 
all the others in his group, having lived con- 
tinuously in the chapter house for at least five 
months. The number of men in fraternities 
A, B, C, and D was 23, 17, 20, and 19, 
respectively. Groups of this size are small 
enough to allow extensive individual inter- 
action and yet sufficiently large to permit 
adequate statistical analysis. 

Collection of the data. All of the subjects 
were first given the Minnesota Multiphasic 
Personality Inventory (MMPI) in group 
sessions. The standard instructions for ad- 
ministering the test were followed [3]. At 
the time of testing an appointment was made 
to see each subject individually in order to 
gather data concerning his self-evaluations 
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and his judgments of the other members in his 
group. 

At the beginning of the individual session, 
each subject was interviewed briefly concern- 
ing his personal history in order to establish 
rapport and gain certain background infor- 
mation. Following the interview the subject 
was presented with a set of small cards, each 
containing the name of one of his associates 
and a code number for recording purposes. He 
was then asked to rank all the members of his 
group, including himself, on seven personality 
traits. Having the individual rank himself as 
well as the rest of his group made possible the 
study of discrepancies between the self- and 
group-judgments of each individual. A des- 
cription of each personality trait was typed 
on a plain, white card to facilitate the rank- 
ing. The traits used, in the order of presenta- 
tion to the subject were: 


1. Leadership. Place the individual whom you 
think would be most desirable as a leader to repre- 
sent the group in campus affairs at the top; rank 
the others in order beneath. 

2. Tolerance. The general disposition of an in- 
dividual to be fair and patient toward people 
whose attitudes are opposed to his own. 

3. Adjustment. Well adjusted, handles personal 
problems well, rarely shows signs of excessive wor- 
ry or anxiety, seems basically happy. 

4. Drive. Drives himself onward, always tries 
hard, very ambitious. 

5. Tactfulness. Tactful, aware of the feelings 
of others, keen, shows good discretion, subtle, not 
blunt, polished and well-mannered. 

6. Gregariousness. Very gregarious, the “life- 
of-the-party” type, mixes well and seems to enjoy 
being around people. 

7. Social Understanding. The needs, motiva- 
tions, interest, and activities of the individuals in 
a group are numerous. Molded together, these di- 
verse needs, etc., give the group a common (held- 
by-the-majority) set of goals, objectives, and pur- 
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poses. At the top, place the individual whom you 
think has the best understanding of—and works 
hardest to achieve—these common goals, objectives, 
and purposes. 

These particular traits were chosen because 
they had been used successfully in previous 
studies [5, 6] employing similar ranking 
methods. 

The interview and ranking session was con- 
ducted in complete privacy and each subject 
was told that his judgments would be guarded 
in strict confidence from the rest of the 
group. The subjects were informed that op- 
portunities to discuss their own MMPI scores 
would be available at the conclusion of the 
study, an arrangement which served to keep 
their motivational level high throughout the 
study. 

Method of analysis. Pooled rank scores for 
each individual on every trait were computed 
separately for each group by summing the in- 
dividual ranks assigned him by his associates 
and placing subjects in rank order according 
to their pooled scores. An individual’s final 
rank on a given trait thus represented the 
consensus of opinion of his associates, provid- 
ing an appropriate measure of one aspect of 
the inferred self, the individual “as an in- 
formed other person sees him” [4, p. 381]. 
Similarly, the rank which the subject assigned 
to himself on that same trait provided a cor- 
responding measure of one aspect of the self 
concept, “those parts of the phenomenal field 
which the individual had differentiated as de- 
finite and fairly stable characteristics of him- 
self” [8, p. 112]. 

The trait description for the self-enhancing 
or more desirable extreme of each trait con- 
tinuum had been deliberately chosen for use in 
this study, so that self rank which was higher 
than the group rank for a particular individ- 
ual would be indicative of a self-enhancing 
discrepancy. On the other hand, a self rank 
which was lower than the group rank would 
indicate a self-depreciative discrepancy. 

At first glance it would appear that a 
simple discrepancy score could be obtained 
merely by subtracting the self rank from the 
group rank. There are two reasons why such 
a method is unsatisfactory. First, rank scores 
have a rectangular distribution while the dis- 
tribution of the underlying trait is more like- 


ly to be roughly normal. A discrepancy of, 
say, three ranks between self and group scores 
at either extreme of the rank order will repre- 
sent quite a different psychological distance on 
the underlying trait continuum than the same 
numerical discrepancy in the middle range. 
Second, the direction and size of such a dis- 
crepancy score is partly a function of the 
group rank. For example, an individual who 
is judged by his associates to be the best ad- 
justed person in his group can only receive a 
self-depreciative discrepancy score while the 
most maladjusted individual can only get a 
self-enhancing score. To the extent that the 
group rank and discrepancy score are corre- 
lated, any conclusion based upon an analysis 
of such simple discrepancy scores would be an 
artifact. 

The first of these difficulties was largely 
overcome by assuming that the underlying 
trait distribution was normal. Tables were 
constructed for each group for converting 
ranks into scale values on the baseline of the 
normal distribution curve so that each of the 
resultant distributions had a mean of 5.0 and 
a standard deviation of 2.0 [2, p. 248]. A 
discrepancy score, (G—S), was computed for 
every individual on each trait by subtracting 
his converted self-score, S, from his converted 
group score, G. 

To eliminate the spurious relationship be- 
tween G and (G—S), the effect of G was 
partialled out in the following manner: A 
scattergram was constructed for each of the 
seven traits by plotting G against (G—S), 
using all 79 individuals. Since in every case 
visual inspection of the scattergram showed 
clearly that the regression line for predicting 
(G—S8) from G was linear with homoscedastic 
arrays, product-moment correlation coefficients 
and regression equations for predicting 
(G—S) from G were computed. As might be 
anticipated from the earlier discussion, the 
correlations (presented in Table 1) were 
sufficiently high in every case to require ad- 


1The validity of this assumption in the present 
instance is borne out by the fact that invariably the 
subject would claim that he had considerable dif- 
ficulty ranking individuals in the middle ranges, 
but that as he moved toward either extreme the 
task became much easier, indicating that the un- 
derlying psychological continuum was bell shaped, 
probably normal. 
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justment of the self-group discrepancy scores. 
Regression equations were plotted on each 
scattergram and corrected discrepancy scores 
were determined by the following equation: 
(G—S).= (G—S) — (G-S)* 
where 
(G—S).= corrected discrepancy score 
(G—S) original discrepancy score 
(G—S)*=discrepancy score predicted 
from regression of (G—S) on 


G. 


Table 1 


Correlation Between G and (G—S) for Each of 
the Seven Traits 











Trait r 
Leadership 71 
Tolerance 68 
Adjustment .79 
Drive 59 
Tactfulness .73 
Gregariousness 63 
Social Understanding 68 





The corrected discrepancy score, (G—S),., 
is that part of the original discrepancy between 
self- and group-judgment for a particular trait 
and individual which remains after the spur- 
ious relationship between G and (G—S) has 
been eliminated. A positive (G—S), can be 
thought of as indicating a self-enhancing tend- 
ency greater than the average individual with 
a comparable G score, the larger (G—S), the 
stronger the relative amount of self-en- 
hancement. Similarly, a negative (G—S),. can 
be interpreted as indicative of less than aver- 
age self-enhancement or even self-depreciation, 
as the case may be. 

Four measures of the discrepancy between 
self concept and inferred self were derived for 
comparison with adjustment as measured by 
the MMPI. The first consisted of (G—S), 
for the trait Adjustment. The second was a 
more general measure of self-enhancing tend- 
ency obtained by summing algebraically 
(G—S), across the seven traits for each indi- 
vidual. This will be referred to as Sum 
(G-—S8),.. The third and fourth scores, 
\(G—S8).| for Adjustment and Sum 
\(G — 8).|, were similar to the first two 


with the exception that the direction of the 
discrepancy was ignored in each case. In a 
sense they are measures of insight defined 
simply as the degree of agreement between the 
inferred self and the self concept. 


Results 


Before attempting to study the relation- 
ships between variables derived from the 
group- and self-judgments and scores on the 
MMPI, the reliabilities of these new vari- 
ables should be examined. The reliability of 
G, the pooled group score assigned each in- 
dividual, has been reported by Greenwood [1] 
in an unpublished study using these same data. 
Reliability coefficients were computed sepa- 
rately for each of the four groups of subjects 
by dividing each group into two halves and 
correlating the pooled scores. As estimated by 
the Spearman-Brown formula the reliabilities 
of the final pooled scores varied from .85 for 
Tolerance to .94 for Leadership, highly satis- 
factory for the present purposes. 

Although the present data permit no evalu- 
ation of the reliability of §, the self-judgment, 
evidence is available from an earlier study on 
a similar group of subjects that the reli- 
ability of self-judgments is also quite high. 
From data provided by Ogdon [6] in a 
longitudinal study of 21 men in a fraternity 
at the University of Texas, the present 
authors obtained high test-retest reliability for 
self-judgments of leadership. The correlation 
between scaled ranks over a three-week period 
was .97. After six weeks during which the 
fraternity elected new officers, calling for 
sharp changes in the self concepts of several 
individuals, the test-retest reliability was .90. 
This suggests that self-judgments obtained by 
the present methods have a high degree of re- 
liability over a time span of at least several 
weeks. 

Since both G and S§ are presumably highly 
reliable, it follows immediately that (G—S), 
and |(G—S),| also have sufficient reliability 
to warrant serious investigation of their re- 
lationships to independent measures of per- 
sonality. 

To have clear meaning as a derived variable, 
Sum (G—S8), should reflect a consistent tend- 
ency for an individual to enhance or depreciate 
himself, relatively speaking, on a variety of 
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personality characteristics. The degree of such 
self-consistency was determined by correlating 
the sums of (G—S), for traits 1, 2, and 7 
with the sums of (G—S), for traits 3, 5, and 
6. The choice of these particular traits was 
based upon a cluster analysis of the trait inter- 
correlations [1] and represents an attempt to 
make the two sets of scores as comparable as 
possible. The situation is somewhat analogous 
to that frequently encountered in test theory 
where over-all test reliability is estimated from 
the correlation between two similar halves, 
although in the present case the halves are 
only roughly parallel at best. The correlation 
between the two sets of scores was only .35, 
a low value but one which is significantly dif- 
ferent from zero. A crude estimate of the reli- 
ability of Sum (G—S), obtained by the Spear- 
man-Brown formula is .56. The low degree 
of consistency in the discrepancies between 
self- and group-judgments from one trait to 
another may be due in large part to consider- 
able variability in the extent to which posses- 
sion of a given personality characteristic pro- 
vides self-esteem. 


In a similar manner, the split-half correla- 
tion for Sum |(G — §).| was determined and 
found to be only .19, too low to justify further 
analysis of this variable. Moreover, the dis- 
tribution of Sum |(G—S).|, is somewhat 
U-shaped due to the summing of (G—S), 
without regard for algebraic sign, making 
comparison with other variables by correla- 
tional methods difficult to interpret. 


Table 2 


Correlations of MMPI Scales with Adjustment and 
Two Measures of Self-Enhancing Tendency 








MMPI 





G for (G—S) . for 
Scale Adjustment Adjustment Sum(G—S), 
Hs ll —.17 —.02 
D .29* —.42** —.17 
Hy A —.03 —.10 
Pd 18 —.16 —.13 
Mf .33* — 14 .02 
Pa .09 —.16 .03 
Pt .34* —.44** —.14 
Sc .30* —.36* —.13 
Ma .14 —.03 Al 





*r significantly different from zero at .01 level 
**r significantly different from zero at .001 level 


After first adjusting raw scores on the 
MMPI for K and then converting to T 
scores using tables given in the MMPI man- 
ual, product-moment correlation coefficients 
were computed between each of the standard 
MMPI scales and each of three scores from 
the rank data: (a) (G—S). for Adjustment, 
(b)Sum (G—S),., and (c) G for Adjustment. 
The group score for Adjustment was included 
because of interest in the relationship between 
adjustment as measured by a personality in- 
ventory and adjustment as judged by an in- 
dividual’s close associates. Table 2 summarizes 
the results of this analysis. 

The pattern of relationships between scores 
on the MMPI and G is somewhat similar to 
that for (G—S), in spite of the fact that G 
and (G—S).. have zero correlation as a result 
of the procedures used to derive (G—S).. 
Sum (G—S),., on the other hand, is not sig- 
nificantly correlated with any of the MMPI 
scales. This is probably due primarily to the 
unusually low reliability of Sum (G—S),. as 
a measure of self-enhancing tendency. 

To the extent that D, Pt, and Sc are 
measures of maladjustment, the highly signifi- 
cant relationship between the MMPI and 
(G—S),. for Adjustment indicates that tend- 
ency to enhance the self is inversely related to 
maladjustment, the more poorly adjusted the 
individual, the more self-depreciative, relative- 
ly speaking, he appears. This finding is in 
agreement with results obtained by Sheerer 
working in an entirely different context. In 
a study of counseling interviews she reported 
“ ..a marked and fairly regular increase in 
the measured acceptance of and respect for 
self from the beginning to the end of the 
cases” [7, p. 175]. In each of ten cases the 
occurrence of self-depreciative statements de- 
creased as the client’s adjustment improved 
during the course of counseling. 

The meaning of the relationship between G 
and the MMPI becomes clearer when the 
structure of the MMPI is examined more 
closely. In a factor analysis of 15 MMPI 
scales, Tyler obtained five factors, the first of 
which was defined chiefly by D, Pt, and Sc, 
the three scales significantly related to G and 
(G—S), in the present study. In interpreting 
this factor, Tyler states, “It appears . . . to 
reflect a chronic state of marginal maladjust- 
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ment including concern with one’s self. Sub- 
jects who score high on the factor would tend 
to have difficulties in their social contacts, 
possibly by reason of their dissatisfactions, 
worry and disgruntlement, and their com- 
plaining and pessimistic attitude” [9, p. 454]. 
The significant relationship between G and 
the Mf Scale suggests that manifestation of 
a feminine interest pattern in a fraternity 
member is sometimes viewed by his associates 
as a sign of maladjustment. 

Using |(G—S).| as a measure of insight 
with respect to adjustment two groups of 
subjects were formed, a High Insight Group 
consisting of 24 individuals with |(G—S),.| 
less than or equal to 0.5, and a Low Insight 
Group comprised of 14 men with |(G—S),| 
greater than or equal to 2.0. Mean T scores 
for these two groups on each of the MMPI 
scales are presented in Table 3, together with 
t values reflecting the significance of the group 
differences. 


Table 3 


Comparison of High Insight Group and Low 
Insight Group on the MMPI 











MMPI Mean T Score 

Scale Low Gp. High Gp. t p 
Hs 56.1 49.2 2.32 05 
D 55.6 54.6 0.22 _— 
Hy 58.0 55.7 1.13 
Pd 60.2 52.0 2.72 01 
Mf 66.5 60.7 2.30 05 
Pa 55.6 52.8 1.15 a 
Pt 60.2 57.1 0.84 _— 
Sc 61.0 56.0 1.48 —- 
Ma 59.3 56.6 0.78 — 





The mean of the Low Insight Group is con- 
sistently higher than that of the High Insight 
Group, sufficiently so for scores in three of 
the MMPI scales to prove significantly dif- 
ferent. This result indicates that individuals 
who manifest poor insight regarding their own 
level of adjustment are more likely to be 
maladjusted than are those who show good 
insight, substantiating the claim which is fre- 
quently made that lack of insight is a sign of 
maladjustment. 


The highly significant difference between 


the two groups on the Pd Scale is of particular 
interest. Although the MMPI scale desig- 


nations must not be taken too literally, the 
frequent interpretation of a high Pd score as 
indicating an inability to profit from experi- 
ence, a tendency to disregard social mores, and 
a general lack of insight [3] is entirely con- 
sistent with the results of this study. 


Summary and Conclusions 


All resident members of four fraternities 
were administered the Minnesota Multiphas- 
ic Personality Inventory. In later individual 
sessions each individual ranked all the mem- 
bers of his fraternity, including himself, on 
seven personality traits, Leadership, Toler- 
ance, Adjustment, Drive, Tactfulness, Gre- 
gariousness, and Social Understanding. A 
normalized pooled rank score (G) for each 
individual on every trait provided an appro- 
priate measure of one aspect of the inferred 
self. The respective self-rank (S) provided a 
corresponding measure of one aspect of the 
self concept. Adjusted self-group discrepancy 
scores, (G-—S)., were used to derive four 
measures of the discrepancy between self con- 
cept and inferred self: (a) (G-—S),. for 
Adjustment, (b) Sum (G-—S),, (c) 
\(G—S).| for Adjustment, and (d) Sum 
|\(G—S).|. The first two served as measures 
of self-enhancing tendency; the latter two as 
measures of insight. 

The major findings of this study are as 
follows: 


1. Corrected self-group discrepancy scores 
obtained by the present procedures are suffi- 
ciently stable to warrant serious consider- 
ation as new measures of personality. 

2. Tendency to enhance the self is inverse- 
ly related to maladjustment, the more poorly 
adjusted the individual, the more self-depreci- 
ative, relatively speaking, he appears. 

3. Maladjustment as judged within a re- 
stricted normal range by an individual’s as- 
sociates is directly related to maladjustment 
as measured by a typical personality inven- 
tory, the MMPI. 

4. Individuals who manifest poor insight 
regarding their own level of adjustment are 
more likely to be maladjusted than are those 
who show good insight. 


Received July 24, 1952. 
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Although it is often assumed that projective 
techniques of personality evaluation have vir- 
tually monopolized the field of clinical psy- 
chology in recent years, and that paper and 
pencil tests of personality are rarely employed 
by reputable clinicians, the fact remains that 
far more research and theoretical papers on 
personality questionnaires have been published 
during the past six years than have been 
published during any equivalent period in the 
history of psychology. Indeed, with the possi- 
ble exception of the Rorschach test, it would 
appear that more research and clinical use is 
now being made of personality inventories 
than of any other type of assessment instru- 
ment; and if educational, vocational, counsel- 
ing, and military applications are included, 
then it would appear that more children and 
adults are now being given personality ques- 
tionnaires than are being given any other type 
of diagnostic procedure or instrument. 


Several comprehensive reviews of the litera- 
ture on personality inventories have appeared 
during the past several years, including those 
by Anderson and Embree [1], Ellis [3, 6, 9], 
Ellis and Conrad [10], Eysenck [11], Strang 
[14, 15], Strang and Pansegrouw [16], 
Traxler [17, 18], and Traxler and Jacobs 
[19]. The present paper will not be another 
such review, but will briefly report the results 
of a study of the effectiveness of personality 
inventories when they are employed for various 
kinds of individual and group discriminations. 
In the course of this study, all research reports 
on personality questionnaires which appeared 
in the literature between January, 1946 and 
December, 1951 were surveyed. The results 
of these research reports were tabulated to 
determine whether, according to the criterion 
and level of significance stipulated by the 
author of each report, the inventory employed 
in each study did or did not significantly dis- 
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criminate among the individuals or groups 
tested. 

A survey of the recent studies of personality 
inventories reveals the following findings: 


1. In 21 studies where intercorrelations 
were calculated among the subscales of differ- 
ent inventories to determine whether they 
were significantly related to each other, 20 
studies showed significantly high correlations, 
indicating that the inventories were not meas- 
uring as many independent traits as their 
manuals claimed that they were. 


2. In 26 studies where scores on one per- 
sonality inventory were correlated with scores 
on another inventory purporting to measure 
equivalent traits, 12 correlations were found 
to be significantly high while 14 were not. 

3. In 12 studies where inventory scores 
were correlated with Rorschach test results, 
significant relationships were found in 2 in- 
stances but were not found in the other 10 
studies. Significant relationships between in- 
ventory scores and other projective technique 
results were found in 1 instance and not found 
in 3 other studies. 

4. In 25 studies where the ability of sub- 
jects to fake personality inventory scores was 
tested, it was found that they could and did 
fake significantly better or worse scores in 22 
instances and that they did not do so in 3 in- 
stances. In several of the studies demonstrat- 
ing that personality inventory scores could be 
faked, it was found that special detection 
scales, such as the F minus K scale of the 
Minnesota Multiphasic Personality Inventory, 
could partially spot and compensate for the 
faking. 

5. Results of using personality inventories 
for making various types of group discrimi- 
nations are summarized in Table 1. In general, 
the data in Table 1 would indicate that the 
inventories significantly differentiate most oft- 
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Table 1 


Significant Discriminations Found in Research Studies with Personality 
Inventories, 1946 to 1951 








































































































Number Number 
of Studies of Studies 
in which in which no Total 
Discriminations Tested Significant Significant Number 
Discriminations Discriminations of 
Were Found Were Found Studies 
Inventory scores vs. diagnostic examinations: 
Neuropsychiatric conditions ~-.......---------.-000----------- 58 26 84 
Psychosomatic conditions ~....... il 2 13 
Delinquent, criminal, and psychopathic behavior —... 15 13 28 
Alcoholism “ 6 1 7 
Predicting success in treatment -.......... ...................... s 24 10 34 
as a Se pon oe 114 52 166 
Inventory scores vs. personality ratings, by associates, 
instructors, or counselors: 
Personality ratings -............._... 8 8 16 
Sociometric ratings 5 5 10 
Total 13 13 26 
Inventory scores vs. behavioral characteristics: 
Extent of social participation 6 3 9 
Leadership success 4 1 5 
Propensity to remain healthy 5 5 10 
Success in courtship and marriage * 3 2 5 
Tendency to become a sexual deviant — = 2 1 3 
Tendency to have a favorable self concept —............ 5 2 7 
Extrasensory perception ability _ 2 2 + 
Success at motor tasks —..... 7 3 10 
Tendency to take pronounced attitudes on 
controversial questions + 3 7 
Miscellaneous behavioral characteristics —......... 15 19 34 
Total 53 41 94 
Inventory scores vs. vocational and academic test and 
performance results: 
Tendency to have specific vocational interests —... ve 11 5 16 
Membership in different vocational groups ...... ~ 12 7 19 
Success in actual vocational performance — 18 23 41 
Success in academic achievement + 21 25 
Total 45 56 101 
Inventory scores vs. group differences: 
Intellectual groups 12 14 26 
Educational groups 2 2 
Age groups 6 1 7 
Sex Groups 13 4 17 
RRS OLE Set ae TS - 3 7 10 
Ethnic groups 5 0 5 
Marriage and family groups 5 5 10 
Disabled and ill groups 3 7 10 
College groups 6 1 7 
Regional and national groups -............................--.-.---- 2 2 + 
Religious groups 2 2 4 
Veterans groups 1 i 2 
Miscellaneous groups 5 1 6 
Total 65 47 112 
Grand Total 290 209 499 
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en when used with psychodiagnostic groups 
and least often when used with vocational and 
academic groups, with their discriminative effi- 
ciency when used with other kinds of criteria 
or groupings falling somewhere in between. 

At first blush, it is difficult to say whether 
the results of these recent researches with per- 
sonality inventories are disappointing or not. 
On the one hand, they would seem to indicate 
that the inventories give reasonably successful 
discriminations when used with neuropsychi- 
atric, psychosomatic, alcoholic, age, sex, ethnic 
and college groups. On the other hand, they 
would seem to indicate that the inventories are 
not measuring the independent traits they are 
supposed to measure; that they do not agree 
too well with each other nor with the results 
of Rorschach and projective tests; that they 
are easily faked; and that they discriminate 
unsuccessfully when used with vocational, aca- 
demic , socioeconomic, and disabled and ill 
groups. Above all, these results would indicate 
that, in virtually none of the areas in which 
they are commonly used, do personality ques- 
tionnaires consistently show significant group 
discriminations. On the contrary, different ex- 
perimenters keep obtaining directly contradic- 
tory results when using the same or similar in- 
ventories. 

Actually, the results shown by this survey 
are less favorable for personality inventories 
than cursory examination would indicate. De- 
tailed analysis of many of the studies surveyed 
shows the same methodological failings that 
Ellis and Conrad [10] pointed out in a previ- 
ous review. That is to say, many of the studies 
in which significant discriminations were ob- 
tained are suspect because they involved criter- 
ion contamination or overlap, inadequate or 
overly diffuse samples, set-up experiments, dif- 
ferential motivation on the part of the sub- 
jects, and statistical and other shortcomings. 
Moreover, since personality inventories are 
normally designed for individual diagnosis or 
assessment, since most of the surveyed studies 
are of group discriminations, and since these 
group results are rarely consistently discrimi- 
native, it is clear that the validity of these in- 
struments for the main specific purpose for 
which most of them have been designed is, 
as yet, far from being solidly established. 

Perhaps the main failing in many of the 


studies surveyed is the tendency of many 
authors to assume that, merely because signifi- 
cant’ score differences have or have not been 
found, significant trait differences have or have 
not been proved. One researcher after another 
keeps concluding that “members of the unac- 
cepted group are more likely to have per- 
sonality disturbances than members of the ac- 
cepted group” [2]; or “a significant relation- 
ship was found to exist between one’s person- 
ality adjustment and his occupational inter- 
ests” [12]; or the like. Such conclusions, of 
course, will not be warranted until it is con- 
clusively shown, beyond a shadow of a doubt, 
that personality scores do have a consistently 
high relationship with “personality disturb- 
ance,” “personality adjustment,” ‘“neurotic- 
ism,” or other traits which their authors and 
publishers claim they have. 

The results of the present study, as well as 
of previous surveys made by the writer [4, 5, 
6, 7, 8, 9, 10], would lead to the conclusion 
that although modern personality inventories, 
when employed for group diagnosis, have some 
degree of validity, scores obtained by individ- 
ual subjects are partly or largely dependent 
upon (a) the subject’s specific motivation at 
the time of taking the test; (4) the conditions 
under which he is tested; (c) his intelligence ; 
(d) his degree of psychological sophistication ; 
(e) his general test-taking attitudes; (f) his 
general psychological defenses; (g) his specific 
(conscious and unconscious) tendencies to lie 
to others and to himself ; and (A) various other 
motivational and attitudinal factors. To con- 
sider these factors adequately, a good many 
“correction” scales or devices must be included 
in modern inventories—such as the various 
correction scales which have been and still are 
being added to the MMPI. So far, however, 
such correction scales have been shown to have 
only a limited effectiveness ; and it may be that 
some of the most needed of these scales—e.g., 
one which would indicate the extent to which 
subjects unconsciously defend themselves 
against answering inventory questions in an 
objective manner—are almost impossible to 
devise, validate, and effectively incorporate in- 
to testing procedure because of the intrinsic 
limitations of personality questionnaires. 

When suitable correction and qualitative 
analytic procedures are devised for use with 
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inventories, they normally add enormously to 
the scoring and interpretation time of the tests. 
Thus, utilizing a test like the MMPI today 
involves scoring the correction as well as the 
clinical scales, interpreting all the scales 
globally in terms of the correction factors and 
in relation to all the other scales, and doing 
a profile analysis rather than simple score in- 
terpretations. 

The question therefore arises: Assuming 
that the newer scoring and interpretation tech- 
niques give a more valid picture of the sub- 
ject’s “personality” than do the older methods 
(an assumption which has not as yet been ex- 
perimentally validated), are they worth the 
time and effort involved? After all, personality 
inventories were originally devised not because 
no other or better methods of assessing certain 
human “traits” were known during the First 
World War (when the Woodworth Personal 
Data Sheet became the first of a long line of 
such instruments), but because they presuma- 
bly offered a quicker and more convenient 
method of “personality” assessment than did 
conventional psychiatric interviews and other 
diagnostic techniques. If, now, as is evident 
from the material in Hathaway and Meehl’s 
monumental MMPI 4¢?las [13], the average 
clinical psychologist must take considerable 
time and trouble to master the technique of 
scoring and interpreting inventory results, and 
then must spend an hour or two scoring, graph- 
ing, and interpreting the results of each in- 
dividual test given, the vaunted “‘advantages” 
of using inventories become most dubious. 

Otherwise stated: since personality inven- 
tories depend, in the last analysis, on printed 
questions, and since virtually no one claims 
for them the advantage of getting at uncon- 
scious and semiconscious material which effect- 
ive clinical use of interview and projective 
methods are generally conceded to some extent 
to uncover, it is difficult to see why clinicians 
should spend considerable time first mastering 
and then using these inventories. The clinical 
psychologist who cannot, in the time it now 
takes a trained worker to administer, score, 
and interpret a test like the MMPI according 
to the best recommendations of its authors, get 
much more pertinent, incisive, and depth- 
centered “personality” material from a 
straightforward interview technique would 


hardly appear to be worth his salt. 


Summary 


A study was made of all researches on per- 
sonality inventories published between Jan- 
uary, 1946 and December, 1951. It was found 
that in most cases inventory scores discriminate 
significantly when used with neuropsychiatric, 
psychosomatic, alcoholic, age, sex, ethnic, and 
college groups. On the other hand, it was 
found that in most instances the inventories 
are not measuring the independent traits they 
are supposed to be measuring; they do not 
agree too well with each other nor with the 
results of Rorschach and projective tests; they 
are easily faked; and they usually do not give 
significant group discriminations when used 
with vocational, academic, socioeconomic, and 
disabled and ill groups. It was especially found 
that, in none of the areas in which they are 
commonly employed, do personality inventories 
consistently show significant group discrimi- 
nations. It was pointed out that when these in- 
ventories are most effectively used, they tend to 
become equally as time consuming as alterna- 
tive psychodiagnostic procedures, such as inter- 
viewing and the use of projective techniques, 
that seem to be more clinically incisive and 
valuable. 


Received June 9, 1952. 
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Distortion in Paranoid Schizophrenia ™ 
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On the basis of clinical observations and ex- 
perimental evidence schizophrenic thought pro- 
cesses have been described as being rigid, 
concrete, and distorted. However, experimen- 
tal studies in this area have not provided con- 
sistent support for most of these generaliza- 
tions. The purpose of this research was to 
investigate distortion in schizophrenia using a 
controlled quantifiable approach. 

In reference to schizophrenic behavior, what 
might be called distortion has been described 
in many ways, ranging from Beck’s [3] “in- 
accurate perception” of clearly implied forms 
to Cameron’s [4] “displacement” of precise 
verbal terms by approximate concepts. In 
Aborn’s review of the literature, he concluded 
that although “it may be regarded as secondary 
to some more fundamental notion of abnor- 
mality, distortion is in its broadest sense pri- 
marily descriptive of the introduction of con- 
tradictory elements into a situation providing 
no external barriers to consistent behavior” 


[1, p. 7]. 
Methodology 


The methodology employed in this research 
stems from the work of Asch [2], Goodman 
and Lorge [5], and Aborn [1]. Using des- 
criptions of hypothetical people, Asch was in- 
terested in how an over-all impression of a 


1This research was presented in part at the meet- 
ings of the Midwestern Psychological Association 
in Cleveland, April, 1952. 

2Published with permission of the Chief Medical 
Director, Department of Medicine and Surgery, 
Veterans Administration, who assumes no respon- 
sibility for the opinions expressed or the conclu- 
sions drawn by the authors. 


The authors are especially indebted to the co- 


operation and assistance provided by Dr. Murray 
Aborn of Michigan State College. 
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person was formed. From the responses of his 
subjects to a checklist of trait names, he found 
that an impression of personality is a function 
of an interaction of traits rather than of 
simple summation. A variation of this proce- 
dure was developed by Goodman and Lorge 
and utilized in a study of the dynamics in- 
volved in the formation of personality im- 
pressions by seventh- and ninth-grade school 
children. Aborn modified the technique as it is 
used in the present research. 

Studying distortion in schizophrenia, the 
latter investigator constructed a number of 
short stories describing hypothetical people. 
Some of the stories utilized positive trait ad- 
jectives only, and some contained only nega- 
tive traits. Further, one set of descriptive 
stories explicitly stated trait names, while 
another simply implied them. For example, the 
all-positive story with trait names explicitly 
stated was as follows: 


The first things people notice about him are that 
he is cheerful and friendly. In school, he always 
got good marks and was looked upon as being in- 
telligent. He is very active and takes part in all 
sports. As a player, he is known to be fearless and 
is respected because he is honest. 


In comparison, the all-positive story with 
the traits implied was: 


On his way home, he found a pocketbook in the 
street and turned it over to the policeman on the 
corner. He smiled and greeted most of the people 
he passed along the street and stopped to talk with 
the man at the newspaper stand. The newspaper 
man likes to listen to him because he usually knows 
what is going on in the world. Sometimes they talk 
about baseball, since they both play on the neigh- 
borhood team. They have known each other ever 
since he chased and caught two men who had 
robbed the newspaper stand. 
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Immediately after reading each story, the 
subject indicated his “picture” of the person 
in the story by checking appropriate words on 
a word-selection checklist, which consisted of 
36 positive and 36 negative adjectives. The 
checklist was constructed to sample all areas of 
personality description, with the affective tone 
of the adjectives being based on the ratings of 
62 judges. For each story, the subject’s 
responses could be quantified in terms of re- 
turn of givens, expansions, and distortions. A 
distortion was operationally defined as a 
response which was inconsistent with the given 
trait pattern of a story; for example, checking 
a negative adjective for a positive story.’ 

While Aborn’s results failed to show any 
statistically significant differences between a 
mixed group of schizophrenics and normals, 
a trend toward greater distortion on the part 
of the experimental group was noted. It seemed 
possible that this trend might be accentuated 
if more opportunity were allowed for the 
schizophrenics to introject the stimulus materi- 
al by inserting a time interval between the pre- 
sentation of the stories and the checklist. 


Experimental Procedure and Subjects 


In testing this hypothesis, the following two 
modifications in methodology were employed: 
(a) the experimental group was confined to 
paranoid schizophrenics; and (4) a temporal 
factor was introduced. After reading each 
story, the subject spent five minutes on a 
simple motor task in which he was required to 
cross out O’s and circle X’s. Then he was pre- 
sented with the checklist and asked to check all 
the words he would use to describe the person 
in the story. This procedure was followed for 
all four stories. The stories were presented in a 
different order to different subjects to mini- 
mize any transfer effects that might be in- 
volved. 

The paranoid schizophrenic and normal 
groups both contained 27 male subjects. The 
groups were equated for age, education, and 
intelligence, as shown in Table 1. The sub- 
jects were selected from a rather limited age 
range; it actually extended from about 22 to 


’For a more detailed account of Aborn’s method- 
ology, a microfilm of his complete manuscript can 
be obtained from University Microfilms, Ann Ar- 
bor, Mich. Publ. No. 2336, Pp. 84. 


35 years. The measure of intelligence was a 
short form of the Wechsler-Bellevue Scale, 
Form 1 (consisting of the Comprehension, 
Arithmetic, and Similarities subtests), which 
Rabin [6] and others have shown correlates 
very highly with the full scale with both nor- 
mals and neuropsychiatric patients. In order 
to reduce the possibility that some of the words 
in the stories or checklist might be misunder- 
stood by the subjects and thus contaminate the 
results, the minimum IQ established for the 
selection of subjects was 100. Further, since 
none of the words in the stories and checklist 
were, according to the Thorndike-Lorge word 
count [7], above seventh-grade comprehension 
(an educational level below all the subjects), 
this was deemed an adequate safeguard. An 
attempt was also made to select the two groups 
so there would be an equivalent range of oc- 
cupations. 


Table 1 
Group Characteristics of the Paranoid Schizo- 
phrenics (N — 27) and the 
Normals (N = 27) 








ae Intelligence 
Education IQ 
SD Mean SD Mean SD 


Group Age 
Mean 





Normals 794 48 123 25 121158 10.0 
Schizo- 


phrenics 30.6 3.9 12.0 2.6 116.1 12.2 





The subjects of the experimental group had 
all been given’ a final diagnosis of “schizo- 
phrenia, paranoid type” by a staff of hospital 
psychiatrists. The majority were open-ward 
patients, and all were cooperative and in good 
contact. All the normals were gainfully em- 
ployed, had never been hospitalized for neuro- 
psychiatric reasons, and were not currently 
undergoing treatment. 


Results 


A comparison of the two groups on the total 
number of adjectives used for each story, 
summarized in Table 2, reveals no differences. 
None of the computed ¢ ratios are above 1.00. 
The data were then analyzed on the basis of 
return of givens for each story, which refers 
to the checking of trait adjectives stated direct- 
ly or strongly implied in the stories. As can be 
seen in Table 3, there was a tendency for the 
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Table 2 
Comparison of the Experimenta! and Control Groups 
on the Total Number of Adjectives Used 











Total Number of Adjectives Checked 





Group Stories* 
1-A 2-A 1-B 2-B 
Mean SD Mean SD Mean SD Mean SD 
ec ilk ee 8.69 17.78 8.07 24.59 9.37 18.11 6.70 
Schizophrenics.............. 26.81 8.56 20.37 10.41 23.70 8.85 19.37 8.01 








*Key: 1, all positive traits; 2, all negative traits; A, traits stated directly; B, traits implied. 


Table 3 


Comparison of the Experimental and Control Groups 


on Return of the Givens 














Return of Givens 








Group Stories 
1-A 2-A i-B 2-B 
Mean SD Mean SD Mean S Mean SD 
OS Sa al a 5.33 0.94 4.63 1.39 §.11 1.02 441 1.49 
Schizophrenics................... 5.00 1.19 4.11 1.81 4.70 1.24 3.78 1.90 
YS eee ee ae eee 1.14 1.18 1.29 1.33 





normals to return more givens and the schiz- 
ophrenics to be more variable. Neither trend, 
however, reaches statistical significance.* 


In analyzing the distortion scores, the chi 
square yielded by Bartlett’s test of homo- 
geneity showed that homogeneity of variances 
for the two groups could not be assumed, 
which introduces certain difficulties for stand- 
ard statistical treatment. An inspection of the 
data suggested that the extreme scores of six 
schizophrenic subjects (high in distortion) ac- 
counted for the marked variance of the ex- 
perimental group. When the extreme distor- 
tion scores made by these subjects (a total of 
11 scores) were eliminated and the chi square 
was computed again, homogeneity of variances 
could then be accepted. We now felt justified 
in employing analysis of variance since discard- 
ing these extreme scores depressed the mean 
distortion values for the experimental group, 
thus working against our hypothesis. As such, 
it would constitute a conservative or “weak” 
test of significance. 


The results of the analysis of variance are 
presented in Table 4. It can be seen that the 


*These results coincide with the findings of 
Aborn who used return of givens as one index of 
rigidity. 





paranoid schizophrenics produced significantly 
more distortion than the normal controls (be- 
yond the 1 per cent level of confidence). Com- 
paring the groups on individual stories showed 
significant differences in stories 2-A (1 per 
cent level) and 1-B (5 per cent level) which 
does not suggest any particular pattern. The 
interaction term between the diagnostic cate- 
gories and stories was not significant, indi- 
cating the experimental subjects did not react 
to the materials in a different manner than did 
the controls. It was a reaction of greater mag- 
nitude but in the same direction. 


Table 4 
Treatment of Distortion Scores by Analysis 
of Variance 








Source of 





Sum of Mean 
Variation df Squares Square F p 
Total 204 282.71 
Diagnostic 
Categories 1 13.74 13.74 19.35 <.01 
Stories 3 17.81 5.94 8.37 <.01 
Individuals 53 144.87 S73" $55. Xan 
Stories vs. 
DC 3 4.56 1.52 62.14 NS 
Error 144 101.73 0.71 





In summary, the paranoid schizophrenics 
showed both significantly more distortion and 


wf binned 


Aa IP 


he aa 


Distortion in Paranoid Schizophrenia 53 


more variability than did the normals. It 
should be pointed out, however, that this dif- 
ference in amount of distortion is a group 
difference, with considerable overlapping be- 
tween groups. As such, it is not adequate for 
individual prediction. 


Discussion 


In light of Aborn’s findings, it would appear 
that schizophrenics do not necessarily deviate 
perceptually from normals in the immediate 
recall of controlled verbal material. However, 
when a temporal interval is interpolated be- 
tween presentation of the material and recall, 
distortion occurs. This is seemingly a result 
of the interaction of a more or less correct per- 
ception with the intervening schizophrenic 
personality variables. The results suggest that 
it is the processes underlying schizophrenic 
thought or judgment that somehow go awry. 

It is realized that there are certain diffi- 
culties in comparing the findings of this re- 
search with those of Aborn. Since two modifi- 
cations in his methodology were used, the 
question arises as to which variable accounts 
for the distortion. The interpolated time in- 
terval has already been discussed. The other 
possibility lies in the nature of the subjects 
used. Although Aborn’s group of schizophren- 
ics of various subtypes was comparable to 
that of this research in terms of such charac- 
teristics as age, education, and intelligence, our 
experimental group was confined to paranoid 
schizophrenics. Since the principle criterion in 
formulating the diagnosis of “paranoid schiz- 
ophrenia” is the presence of “projective” think- 
ing (as seen in delusions), this factor may be 
the crucial one in producing distortion. The 
answer to this question seems obtainable in 
further research with this technique in which 
the following comparisons would be made: (a) 
paranoid schizophrenics vs. normals without 
the temporal interval; and (6) nonparanoid 


schizophrenics vs. normals with the temporal 
interval. 


Summary 


The purpose of this research was to investi- 
gate distortion, a characteristic often attri- 
buted to the behavior of schizophrenics. The 
methodology employed four short stories des- 
cribing hypothetical people and a word-selec- 
tion checklist. After reading each story, the 
subject spent five minutes on a simple motor 
task. He was then presented with the checklist 
and asked to check all the words he would use 
to describe the person in the story. A distor- 
tion was defined as the checking of a word 
which was inconsistent with the given trait 
pattern of a story. The subjects consisted of 27 
paranoid schizophrenics and 27 normals, the 
two groups being equated for age, education, 
and intelligence. A statistical analysis of the 
data revealed that the experimental group 
showed both significantly more distortion and 
more variability than the normals. The results 
were compared and discussed in terms of the 
findings of Aborn, who developed the basic 
methodology used in this research. 


Received June 23, 1952. 
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Some Effects of Sodium Amytal on 
“Deteriorated” Schizophrenics 


Willard A. Mainord 


State College of Washington? 


Conflict still exists as to the nature of schizo- 
phrenia, much of the controversy centering 
upon whether this pathology is of an organic, 
functional, or psychosomatic nature. Schizo- 
phrenic “deterioration,” in particular, remains 
obscure as to nature and genesis, and it is ob- 
vious that more knowledge is necessary for 
best clinical results. Three types of theories 
are advanced to explain schizophrenic deterio- 
ration, i.e., schizophrenia is a progressive, or- 
ganic disease; schizophrenia is a strictly func- 
tional disorder which serves some defensive 
function in the psychological economy of the 
individual; and, schizophrenia is a psychoso- 
matic malady, and causal factors as well as 
disease processes may be both organic and 
functional. Cameron [2] notes that a rigid or- 
ganic point of view usually implies actual brain 
deterioration not amenable to anything but 
physiological treatment, and with little hope of 
full restitution of intellectual efficiency. 

The usual definition of schizophrenic de- 
terioration is descriptive, but recently Levy 
and Kennard [7] have advanced a concept of 
deterioration with more objective criteria. 
Their study shows a relationship between 
clinical judgment of deterioration, abnormal- 
ity of EEG records, and significantly large 
Wechsler-Bellevue deterioration ratios. These 
criteria can be duplicated by other investiga- 


1This paper is derived from a study done as a 
master’s thesis under the direction of Dr. J. H. El- 
der to whom grateful acknowledgment is made. 
Acknowledgment is also made to Dr. Sol Levy, 
Clinical Director, Eastern State Hospital, Medical 
Lake, Washingten and to the clinical staff for the 
interest and cooperation shown relating to this 
study. All conclusions, of course, are the author’s 
own, and the responsibility for them entirely his. 


?Now at the University of Washington. 
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tors, and comprise the operational definition 
of schizophrenic deterioration used in this pa- 
per. 


If schizophrenic deterioration can be allevi- 
ated without organic change, psychological 
therapies would appear to offer hope for re- 
habilitation of deteriorated patients. Layman 
[5, 6] has demonstrated that it is possible to 
obtain a temporary improvement in the intel- 
lectual performance of an unselected group of 
schizophrenics through injections of sodium 
amytal. There is evidence [1, 8, 9] which in- 
dicates that these results may come from 
changes in motivational states which come 
about as a result of the action of this drug. 
The problem investigated in this paper can be 
stated as follows: can a statistically significant 
improvement in performance be obtained from 
deteriorated schizophrenics, as defined by the 
criteria suggested by Levy and Kennard, while 
the patients are under the influence of sodium 
amytal ? The working hypothesis was that such 
an improvement could be obtained because of 
motivational changes resulting from the drug. 


The nature of the criteria suggested the fol- 
lowing secondary hypotheses: if schizophrenia 
is a progressively disabling disease, there 
should be a significant negative correlation be- 
tween the subjects’ ages and their obtained 
IQ’s; and there should be a significant posi- 
tive correlation between the improvement ob- 
served under amytal and the size of the de- 
terioration ratio. This latter hypothesis is 
based on the assumption that the Wechsler- 
Bellevue deterioration ratio does measure or- 
ganic damage, and that the greater the amount 
of tissue pathology, the greater the amount of 
potential improvement. 


+ ae 
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Procedure 


The criterion given the most weight in the 
selection of subjects was clinical judgment, in- 
asmuch as behavior itself is basic to any con- 
cept of deterioration. As an additional pre- 
caution, the theorized progressive nature of the 
disease was allowed for by selecting only sub- 
jects who were considered to have had the ill- 
ness for at least five years. The abnormality 
of the EEG records was determined by a com- 
petent specialist. The minimum Wechsler- 
Bellevue deterioration ratio acceptable for the 
experimental group was 15 per cent after cor- 
rection for aging—as Wechsler [11] suggests 
10 per cent as a minimum significant figure. 
All subjects who had been subjected to any 
kind of therapy after the original testing were 
excluded. Table 1 summarizes the mean age, 
known duration of illness, deterioration ratio, 
and IQ for both the experimental and test- 
retest groups. The test-retest group was used 
only to give some indication of usual test-re- 
test effects on long-standing schizophrenics, in- 
asmuch as the experimental control was ac- 
complished by comparing pre-amytal with post- 
amytal scores. All cases were selected from the 


same population as that used by Levy and Ken- 
nard. 


Table 1 
Mean Age, Known Duration of Illness, Deteriora- 
tion Ratio, and IQ for Experimental and 
Test-Retest Groups. 











Mean 
" Mean Deterio- 
Group a Mean Dura- ration Mean 
Age tion ratio* IQ* 
Experimental 22 43.5 136 314% 84.5 
Test-retest 18 41.0 10.4 12.6% 100.6 





*The utilization of the criteria for selection so di- 
minished the original population that it was impossible to 


match these two groups for IQ and for deterioration 
ratio. 


The subjects, experimental and test-retest, 
were originally tested with the Verbal section 
of Form I of the Wechsler-Bellevue Intelli- 
gence Scale in a two-week period from De- 
cember 20, 1950 to January 5, 1951. The ex- 
perimental group was retested approximately 
nine months later while under the influence of 


sodium amytal.* The final test was adminis- 
tered to the experimental group approximately 
one week later, again under conventional con- 
ditions. The test-retest group was also retested 
at this time. 


Results 


The results obtained can be said to bear 
out the hypothesis that a significant, temporary 
improvement in measured intellectual perform- 
ance would be obtained through the adminis- 
tration of sodium amytal. 


Table 2 


Mean Group Scores of Experimental and Test- 
Retest Groups on Wechsler-Bellevue Ver- 
bal Scale under all Test Conditions 








Pre- Under Post- 





Group Amytal Amytal Amytal 
Experimental 84.5 94.1 86.4 
Test-retest 100.6 — 


101.6 





Table 2 summarizes the results, in which 
it can be seen that the mean Verbal IQ of 
the experimental group increased to 94.1 from 
84.5 under sodium amytal, and dropped back 
to 86.4 in the post-amytal testing. In other 
words, the experimental group, while under 
the influence of the drug, increased its mean 
Verbal IQ by 9.6 points (significant at better 
than the .001 level of confidence), and then 
lost 7.7. points of this gain (significant at bet- 
ter than the .001 level of confidence) when 
the same test was administered again without 
the drug. The difference between the means 
of the pre- and post-amytal conditions was not 
statistically significant, despite practice effects. 
The test-retest group improved its perform- 
ance from 100.6 to 101.6, this one-point gain 
being comparable to the 1.9-point gain be- 
tween the first and third testing of the experi- 
mental group. 

The secondary hypotheses were not con- 
firmed by the data, inasmuch as the correla- 
tions obtained in each case were insignificant. 
Thus, only the primary hypothesis, i.e., that a 


8The drug was administered intravenously in a 
solution composed of one grain per cc. of distilled 
water. No set dosage was used; the drug was dis- 
continued when the subject seemed to have reached 
a testable level which appeared optimal from ob- 
server judgment. 
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significant improvement in performance of de- 
teriorated schizophrenics could be obtained by 
injection of sodium amytal, was supported by 
the results obtained. 


Discussion 

If sodium amytal does not temporarily miti- 
gate organic pathology, the obtained data 
would seem to support the point of view that 
schizophrenic deterioration is not entirely 
physiological. In view of other work [8, 9], 
it would seem logical to ascribe the improve- 
ment noted to changes in the patients’ motiva- 
tion. Therapeutically, it might be expected 
that schizophrenia and its accompanying de- 
terioration may be partly mitigated by psy- 
chological methods. A permanent improvement 
in all spheres of behavior of comparable mag- 
nitude to the temporary intellectual improve- 
ment obtained in this study would be enough 
to return many deteriorated schizophrenics to 
society. Failure of such methods to date may 
be due to lack of perseverance with difficult 
patients, inadequate techniques, and lack of 
funds at the insistence of economy-minded 
legislators and administrators. 


This study suggests that the severity of the 
schizophrenic process may have little or noth- 
ing to do with length of illness. A familiar 
sight in any institution is the well-preserved 
paranoid schizophrenic of many years stand- 
ing. This study further suggests that no mat- 
ter what Wechsler’s deterioration ratio does 
measure [3, 4, 10, 11], it does not seem ap- 
plicable to schizophrenic deterioration, as no 
relationship between these ratios and the data 
could be detected.* 


Of striking interest, but difficult to evalu- 
ate, were the results obtained through the use 
of amytal with patients otherwise untestable. 
Five such patients (none of them otherwise 
used in this study) were tested, and four of 
them yielded scorable protocols with Verbal 
1Q’s ranging from 60 to 95, apparently indi- 
cating that much potential is still available to 
many of the most deteriorated patients. 


“Subtest analysis was also sterile both in terms of 
isolating differential improvement and in terms of 
subtest scatter. Amytal improvements were evenly 
distributed over all of the subtests, and the scatter 
remained extensive—often increasing. 


Summary 


Twenty-two deteriorated schizophrenics 
were tested to obtain psychological measure- 
ment of intellectual ability both with and 
without the use of sodium amytal. Deterio- 
rated schizophrenics were defined as those: 
who had a known illness of at least five years 
duration ; who were judged clinically to be de- 
teriorated; who showed a significantly large 
Wechsler-Bellevue deterioration ratio; and 
who showed an abnormal EEG record. A test- 
retest group, comparable in age, length of ill- 
ness, and clinical judgment was used to obtain 
some data on test-retest effects. 

The experimental group was administered 
the Verbal Scale of the Wechsler-Bellevue 
three times—the first time conventionally, the 
second time under sodium amytal, and the 
third time under usual conditions. The test- 
retest group was conventionally tested twice. 
The primary hypothesis tested was that a sta- 
tistically significant improvement in perform- 
ance would be obtained with subjects under 
sodium amytal over non-amytal tests. This hy- 
pothesis was confirmed by the data, as these 
differences were statistically reliable, while the 
differences between the first and third testings 
were statistically insignificant. 

A discussion of implications for psychother- 
apy followed indicating that the obtained re- 
sults support the argument that psychotherapy 
might be successfully utilized with deterio- 
rated schizophrenics, and that such patients 
still have a potential capacity beyond their ob- 
served behavior. The applicability of the 
Wechsler-Bellevue deterioration ratio to this 
illness was considered, the conclusion being 
that such use was of extremely doubtful va- 
lidity. The over-all conclusion from this study 
was that there is a functional component in 
schizophrenic deterioration which may be 
amenable to psychological methods. 


Received July 28, 1952. 
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Influence of Socioeconomic Status on Wechsler 
Intelligence Scale for Children: 
An Exploratory Study 


Betsy Worth Estes 


University of Kentucky 


The present study is a preliminary explora- 
tion toward determining whether socioeconom- 
ic level affects responses to the items of the 
Wechsler Intelligence Scale for Children so 
that test differences between upper and lower 
socioeconomic levels are manifest in: 


1. The distribution of IQ’s (means and 
variances ). 


2. The prediction value of the WISC, i.e., 
its correlation with an achievement test. 


3. The pattern of test responses as indi- 
cated by subtests and intercorrelations between 
the subtests. 


Subjects and Procedure 


Two groups of children were studied: one 
of upper economic status (N40), one of low 
economic status (N=40). The subjects in the 
upper economic group were from the univer- 
sity school, which is essentially a public 
school except for the nominal tuition charged. 
This school is one of several in which can be 
found a fairly large number of children from 
very comfortable homes—upper economic 
status. lhe fathers of these children are uni- 
versity professors, lawyers, physicians, bankers, 
editors, merchants, clergymen, etc. The sub- 
jects in the low economic group were from 
five public schools. The fathers of these 
children are day laborers, night watchmen, 
junk collectors, etc. 

Of the total of 80 children, one-half were 
boys and one-half were girls. One-half were 
seven years of age, plus or minus two months, 
and in the second grade; the other half were 
ten years of age, plus or minus two months, 
and in the fifth grade. These two ages were 
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selected in order to investigate whether dif- 
ferences in socioeconomic level effect differ- 
ences in the pattern of test responses as com- 
pared with the intercorrelations of the sub- 
tests with those at seven and ten as published 
by Wechsler [9]. 

To determine socioeconomic level, the 
Warner-Meeker-Eells’ Index of Status Char- 
acteristics was used [8]. This index uses 
four factors: occupation of father, source of 
income, house type, and characteristics of the 
dwelling area. The factors are rated and a 
weighted total of the ratings is obtained. The 
total is converted to social-class equivalence as 
upper-upper, lower-upper, upper-middle, low- 
er-middle, upper-lower, lower-lower. Table 1 
shows the social class ratings of the subjects 
in the study. There is no overlapping of the 
two groups. The subjects were selected only 
on the bases of sex, age, grade, and socio- 
economic level. 


Table 1 
Distribution by Social Class Level 








Second grade _ Fifth grade 





Status Index Boys Girls Boys Girls Total 
Upper Group 
Upper-Upper 0 0 0 0 0 
Lower-Upper 1 0 2 2 5 
Upper-Middle 6 9 5 8 28 
Lower-Middle 3 1 3 0 7 
Lower Group 
Upper-Lower 4 0 1 3 8 
Lower-Lower 6 10 9 7 32 
Total 20 20 20 20 80 





The WISC was administered to all sub- 
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Table 2 


Means, SD’s, Verbal and Performance Scaled Scores on the WISC 








Second grade 


Fifth grade Total group 





M SD t M SD t M SD t 
Full Scale 
| EE 114.4 9.49 115.65 11.14 115.02 10.37 
4.20** 1.96 4.09** 
anna 101.8 8.99 108.15 12.45 104.98 11.31 
Verbal Scores 
as 72.65 8.67 78.0 9.28 
3.94** 2.06 
Lower........... 61.65 8.98 71.0 12.06 
Performance Scores 
J es 70.0 11.95 68.0 11.68 
2.62* 1.63 
Lowet.............. 61.4 8.53 


62.0 11.58 





**Significant at the 1 per cent level. 
* Significant between the 1 and 5 per cent levels. 


jects. The full scale of twelve subtests was 
used. 

The second problem, that of “validity,” was 
approached by giving all subjects the Metro- 
politan Achievement Test. The second-graders 
took Primary I Battery, Form R. The fifth- 
graders took the abbreviated form of the In- 
termediate Battery, Form R, which included 
tests of reading, vocabulary, arithmetic funda- 
mentals, arithmetic problems, English, and 
spelling. 

The third problem was investigated by 
means of intercorrelations of subtests of the 
WISC computed for the subjects in this study. 


Results 


I. Does Socioeconomic Level Effect Differ- 
ences in Distribution of IQ’s? 


1. Analysis of variance using the method 
of repeated measurements on the same sub- 
jects, analogous to the method described by 
Edwards [1], shows that scores on the WISC 
varied with socioeconomic level, with sex, and 


with verbal and performance halves of the 
WISC.* Scores were analyzed in terms of 


1To reduce printing costs Tables 5, 6, 7, 8 and 9 
have been deposited with the American Documen- 
tation Institute. Order Document 3837 from Ameri- 
can Documentation Institute, c/o Library of Con- 
gress, Washington 25, D.C., remitting $1.00 for 
microfilm (images 1 inch high on standard 35 mm. 
motion picture film) or $1.00 for photocopies (6 x 8 
inches) readable withhout optical aid. 


sex, although, since the numbers were equal, 
this variable was not of primary concern in 
this study (Table 5, deposited with ADI). 

2. Table 2 shows a difference in mean IQ 
for the total group, i.e., both grades combined. 
The mean of the upper economic group was 
superior to the mean of the lower economic 
group. The variability of the two groups as 
expressed by the SD’s did not differ signifi- 
cantly. 

When the total group is divided by grade 
(or age), it is found that in the second grade 


Table 3 


Mean IQ and SD by Grade, Economic Level, Sex 











M SD t 
Second Grade 
Upper 
Male 116.7 10.23 
1.06 
Female 112.1 9.04 
Lower 
Male 106.4 10.09 
2.53* 
Female 97.2 4.19 
Fifth Grade 
Upper 
Male 117.0 7.13 
51 
Female 114.3 13.93 
Lower 
Male 111.0 11.85 
998 
Female 105.3 12.38 





*Significant at better than the five per cent level. 
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(Table 2) the difference in means is again 
very significant, better than the 1 per cent 
level. There is only one subtest in which the 
lower group exceeds the upper group—Cod- 
ing. 

In the fifth grade, however, the differences 
in means are not significant although there is 
only one subtest in which the lower group 
exceeds the upper group—Digit Span. 

Table 2 also shows the comparison of the 
verbal and performance scores on the WISC. 
The differences were significant in both verbal 
and performance scores in the second grade 
but in the fifth grade only the verbal IQ 
means differed. 

3. Table 3 presents the differences in mean 
IQ for the two grades and two economic 
groups by sex. The difference is significant 
only in the lower economic group in the 
second grade. 

Thus, in answer to the first question, dif- 
ferences in socioeconomic level effect differ- 
ences in scores on the WISC for the total 
group studied. When the group is separated 
by grade (or age), however, these differences 
exist for the second grade (seven-year-olds) 
but are not significant for the fifth grade (ten- 
year-olds). 


II. Does Socioeconomic Level Effect Differ- 
ences in Prediction Value of the WISC? 


1. The second major finding was that 
there is not a significant difference between the 
two economic groups as to predictive power of 
the WISC. Using Fisher’s z transformation 
it is found that the difference between the cor- 
relations with achievement in the second grade 

r= .54 and r=.33) is not significant at the 
5 per cent level; nor is the difference (r = 
.77 and r = .46) significant for the fifth 
grade. Thus if achievement is used as the cri- 
terion, the WISC did not predict better for 
one economic group than the other. 


III. Does Socioeconomic Level Effect Differ- 

ences in the Pattern of Test Response as In- 

dicated by Subtests and Intercorrelations be- 
tween the Subtests? 

This problem was divided into three parts: 

1. In terms of intercorrelations, how does 


the sample used in this study compare with 
Wechsler’s standardization data? 





2. In terms of intercorrelations, how does 
this sample when separated by socioeconomic 
level compare with Wechsler’s standardization 
data? 

3. Are there differences in the intercorrela- 
tions of subtests between upper economic 
status and lower economic status? 

1. Comparison of whole group with stand- 
ardization data. The intercorrelations of the 
seven and one-half year old group were com- 
pared with those presented by Wechsler [9] 
and the intercorrelations for the ten and one- 
half year old groups with those presented by 
Wechsler [9]. (See Tables 6, 7, deposited 
with ADI.) The level of 5 per cent was com- 
puted by Fisher’s z transformation as given by 
Edwards [1]. 

Those which differ are Arithmetic and In- 
formation, Similarities and Comprehension, 
Arithmetic and Vocabulary, Arithmetic and 
Digit Span, Arithmetic and Coding, Vo- 
cabulary and Digit Span, and Picture Ar- 
rangement and Object Assembly. Out of a 
total of sixty-six intercorrelations, nine in the 
seven and one-half year group differ at the 5 
per cent level from Wechsler’s. 

At the ten and one-half year old level, the 
r’s which differ from Wechsler’s are Informa- 
tion and Arithmetic, Comprehension and Digit 
Span, Arithmetic and Vocabulary, Arithmetic 
and Digit Span, Arithmetic and Picture Ar- 
rangement, and Arithmetic and Coding. That 
is, six intercorrelations out of sixty-six differ at 
the 5 per cent level. 

The striking observation in those tests which 
differ is that it is Arithmetic which so frequent- 
ly enters into the intercorrelations. At seven 
years old, six out of the nine which differ are 
combinations including Arithmetic, and at ten 
years old, five out of the six include Arithmetic. 
In each of these cases, the intercorrelations in 
this study are lower than those presented by 
Wechsler. Since Arithmetic is so strongly in- 
fluenced by school training, this may be a re- 
flection of differences in educational systems. 

Since only nine at the seven and one-half 
year level (out of sixty-six) and six at the ten 
and one-half year level (out of sixty-six) differ 
from Wechsler’s data, we assume that our 
groups conform to the standardization data 
and that they are representative. 

2. Comparison of group separated on basis 
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of socioeconomic level with standardization 
data. Each age group was separated according 
to socioeconomic level and the intercorrelations 
compared with Wechsler’s standardization 
data for each age. Again no essential differ- 
ences from the standardization group were 
found. (See Tables 8, 9, deposited with ADI.) 

(a) In the upper economic group at seven 
and one-half years, those r’s which differ be- 
yond the 5 per cent level are Information and 
Picture Arrangement, Information and Block 
Design, Information and Object Assembly, In- 
formation and Mazes, Arithmetic and Vo- 
cabulary, Arithmetic and Picture Completion, 
Arithmetic and Picture Arrangement, Arith- 
metic and Block Design, Similarities and Pic- 
ture Arrangement, Vocabulary and Digit 
Span, Vocabulary and Object Assembly, Vo- 
cabulary and Coding, and Vocabulary and 
Mazes. 

Those which differ in the lower group at 
seven and one-half years are Information and 
Arithmetic, Arithmetic and Vocabulary, Arith- 
metic and Digit Span, Arithmetic and Coding, 
Vocabulary and Digit Span, Digit Span and 
Object Assembly, Picture Arrangement and 
Object Assembly, and Object Assembly and 
Mazes. 

Thus in the upper group thirteen intercor- 
relations out of sixty-six differ from Wech- 
sler’s; in the lower group, eight differ. Since 


Table 4 


Scaled Score Differences between Economic 
Groups in Subtests 








Differences in economic 
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groups in points 
Subtests Second grade Fifth grade 
Information 49 18 
Comprehension 43 36 
Arithmetic 12 3 
Similarities 58 43 
Vocabulary 53 50 
Digit Span 5 ~10t 
Picture Completion 10 12 
Picture Arrangement 51 32 
Block Design 48 23 
Object Assembly 37 32 
Coding —9t 16 
Mazes 53 8g 





+No sign indicates that the upper economic group had 
more points. A minus sign indicates that the lower eco- 
nomie group was superior. 


61 


the number of cases was so much smaller in 
this study than in Wechsler’s group, it is as- 
sumed that there are no essential differences. 

(+) At ten and one-half years, in the upper 
economic group, differences from Wechsler’s 
are obtained in eight intercorrelations: In- 
formation and Arithmetic, Comprehension and 
Digit Span, Comprehension and Picture Com- 
pletion, Arithmetic and Digit Span, Arithmetic 
and Picture Arrangement, Arithmetic and 
Coding, Similarities and Picture Completion, 
and Vocabulary and Block Design. 

In the lower economic group, there are no 
r’s which differ significantly from the stand- 
ardization data. 

3. Intercorrelations of subtests according to 
socioeconomic level. The third comparison 
(Table 8, ADI) is of intercorrelations accord- 
ing to socioeconomic level. At seven and one- 
half years five r’s differ according to socio- 
economic level: Information and Picture Ar- 
rangement, Arithmetic and Picture Arrange- 
ment, Vocabulary and Coding, Digit Span and 
Block Design, and Digit Span and Object 
Assembly. 


At ten and one-half years, (Table 9, ADI) 
only two r’s differ according to socioeconomic 
level: Arithmetic and Digit Span, and Picture 
Arrangement and Object Assembly. 


Table 4 shows the differences between eco- 
nomic groups in the subtests in standard score 
units. In general, it is the verbal items that 
show the greatest differences—Vocabulary, 
Similarities, Comprehension. 


The results of this study, therefore, suggest 
that socioeconomic level effects differences (a) 
in magnitude of scores on the WISC but not 
(4) in pattern of scores and (c) that socioeco- 
nomic level does not effect differences in pre- 


diction value of the WISC. 


Discussion 


Several explanations might be suggested for 
the decrease in socioeconomic effects on Wech- 
sler IQ with increase in age or grade. Does 
a selective factor operate so that only the 
brightest of the lower economic group persist 
to reach the same grade at the same age as the 
upper economic group? The duller ones may 
still be in the third and fourth grades and 
only the most capable regularly promoted. 
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Is it possible that the public schools are nar- 
rowing the differences occasioned by economic 
status in the home so that with increase in age, 
there is a decrease in the discrepancy between 
measured IQ in the economic groups? Many 
studies have shown a decrease in IQ with in- 
crease in age [3, 7]. However, the pupils in 
these studies were continuing in an extremely 
impoverished environment with a minimum of 
stimulation. The subjects in this study were 
in good public schools where there was con- 
stant encouragement and stimulation. This is 
an attractive explanation if its validity could 


be established. 


A third explanation may be consonant with 
research at the University of Chicago [2, 4, 5, 
6}, that test items are constructed for and 
favor the middle and upper economic groups 
and penalize the lower group. Thus at an 
early age when the home environment is most 
influential, the lower group does poorly. At a 
later age, the middle-class influences of school, 
Sunday School, movies, etc., are beginning to 
be evidenced and may affect responses on the 
WISC. 

Since this study suggests that socioeconomic 
differences as reflected in the WISC decrease 
with age, the WISC may become a preferred 
test in clinical and educational situations at 
older ages. Future studies might investigate 
this hypothesis at older ages than used in the 
present study. 


Summary and Conclusions 


Two groups of subjects, of upper and of 
lower economic level, 40 in each group, were 
selected on the bases of age, sex, grade, and 
socioeconomic status. One-half were seven and 
one-half years, plus or minus two months, in 
the second grade; one-half were ten and one- 
half years, plus or minus two months, in the 
fifth grade. One-half were boys ; one-half were 
girls. 

Socioeconomic level was determined by the 
Warner-Meeker-Eells’ Index of Status Char- 
acteristics. There was no overlapping between 
the two groups. 

The full scale of twelve subtests of the 
Wechsler Intelligence Scale for Cl.ildren was 
administered. The Metropolitan Achievement 
Test was given to each subject. 


The results were analyzed as a preliminary 
exploration toward determining whether socio- 
economic level affects responses to the items 
of the WISC so that test differences between 
upper and lower socioeconomic levels are mani- 
fest in: 

1. The distributions of I1Q’s. 

2. The predictability of the WISC. 

3. The pattern of test response as ‘ndicated 
by intercorrelations of the subtests (a) with 
Wechsler’s standardization data and (6) be- 
tween economic levels. 

Scores on the WISC vary with socioeco- 
nomic level in respect to magnitude of score; 
the upper econoimic group was superior to the 
lower economic group. When the groups 
were divided by age or grade, the difference 
was significant at the seven and one-half year 
level, not significant at the ten and one-half 
year level. 

The WISC did not predict better for one 
economic group than for the other. 

Patterns of scores on the WISC did not 
appear to be differentiated by socioeconomic 
level. 


Received July 21, 1952. 
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A Comparison of the Wechsler-Bellevue and ACE 
Tests on a University Counseling Center Group 


Reed M. Merrill and Louise B. Heathers 


University of Washington Counseling Center 


As indicated by the many studies reviewed 
by Rabin [6], Watson [91], and Rabin and 
Guertin [7], the Wechsler-Bellevue Intelli- 
gence Scale (W-B) is very widely used as a 
measure of general ability. Relatively few 
studies, however, have been made regarding 
its validity for predicting academic perform- 
ance at the college level. In this study W-B 
1Q’s are compared with scores on the Ameri- 
can Council on Education Psychological Ex- 
amination (ACE). The ACE was selected 
because of its widespread use as the measure of 
scholastic aptitude given entering college 
freshmen. Two points are of interest: (a) 
the relative capacity of the two tests to predict 
academic achievement at the college level and 
(b) the relationship between the scores ob- 
tained on the two tests. 


These relationships have been investigated 
in three previous studies. Anderson [1] gave 
the W-B and the ACE to all but two members 
of an entering freshman class in a woman’s 
college. The 1940 ACE was given on en- 
trance; the W-B, some time during the stu- 
dent’s second semester. ACE raw scores were 
used in the correlations. The mean Verbal, 
Performance, and Full Scale W-B IQ’s for 
this group of 112 Ss were 116.0, 115.8, and 
118.5, respectively. Sartain [8] gave the W-B 
and the 1942 ACE to 50 college freshmen. 
The sex of the Ss was not specified. Presum- 
ably they were volunteers. ACE raw scores 
were used in the computations. The mean Ver- 
bal, Performance, and Full Scale W-B 1Q’s 
for this group were 115.4, 115.1, and 117.5, 
respectively. The measure of scholastic 
achievement used in both studies was the 
grade-point average (GPA) obtained by a 
student during his freshman year. Gerboth 


63 


[3], in studying the relationship between Forms 
I and II of the W-B, gave Form I to 25 men 
and 25 women at some time during their col- 
lege career. The median class placement of 
the Ss was at the sophomore level but all 
classes were represented. Presumably these 
Ss were volunteers. Some of these Ss had 
taken some form of the ACE on entrance. 
The number of Ss in the Form I group for 
whom ACE scores were available and the 
average time interval between the two testings 
are not known. Since various forms of the 
ACE had been taken by the Ss, ACE centiles 
were used in the computations. The measure 
of scholastic achievement used was the GPA 
obtained during one semester, probably the 
semester during which the W-B was given. 
The mean Verbal, Performance, and Full 
Scale W-B IQ’s for this group were 124.4, 
122.1, and 125.6, respectively. 

The study reported here was based on 251 
male students who were part of a larger sam- 
ple seen over a two-year period at a university 
counseling center. The total group of Ss is 
described in detail elsewhere [5]. The 251 Ss 
were those members of the original group who 
had taken some form of the ACE as entering 
freshmen at the University of Washington. 
Since the W-B was taken at the time the stu- 
dent came to the counseling center, the class 
level of the Ss and the time interval between 
the two test administrations varied. When they 
were given the W-B, 55% of the Ss were 
freshmen, 31.5% were sophomores, and 13.5% 
were upper-division students. Their median 
age at this time was 20.96 years with a Q 
of 2.26 years. The median time interval be- 
tween the two tests was 11.02 months with a 
Q of 8.52 months. The measure of scholastic 
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performance was the GPA achieved in aca- 
demic subjects for the freshman year. The 
mean GPA" was 2.10 with a standard devi- 
ation of .63 and a range from 0.0 to 3.8; the 
mean GPA for all freshmen at the University 
of Washington during the period covered 
by the study was 2.2.2 Table 1 pre- 
sents the mean W-B IQ’s and mean local 
entering-freshmen centiles obtained by the 
group. Local centiles were used in all compu- 
tations since various editions of the ACE had 
been taken by the Ss and these centiles were 
more stable from year to year for the local 
population than the national centiles. 


Table 1 


Means and Standard Deviations on the W-B and 
the ACE Tests of Student Client Group 

















(N= 248) 
Wechsler-Bellevue IQ’s 

Verbal Performance Full 

Scale Scale Scale 
Mean 117.70 118.21 120.07 
o 8.55 9.72 8.64 

Local ACE Centiles 

O Scale L Scale T Scale 
Mean §2.25 47.75 49.05 
go 28.10 29.30 29.00 





As may be seen in Table 2 the correlations 
found between GPA and both the W-B IQ’s 
and the ACE scores tend to be quite similar 
in the four studies. In general the W-B Full 
Scale predicts college achievement as well as 
does the Total ACE. The Verbal Scale pre- 
dicts achievement better than any of the other 
scales while the Performance Scale predicts 
less well than any of the other scales. The re- 
sults on the ACE are in agreement with those 
reported by Berdie et al. [2]; ie., (a) the Lin- 
guistic (LL) Scale predicts general achievement 
as well as the Total ACE Scale and somewhat 
better than the Quantitative (Q) Scale, and 
(6) the correlations between grades and ACE 
scores are consistently higher for the female 
than for the male groups. It is of interest that 


1$ince three students withdrew prior to obtain- 
ing any grades, all data involving GPA are based 
on 248 instead of 251 S's. 


2A grade of C has a point value of 2.0 at the 
University of Washington. 


Table 2 
Comparison of Correlations of W-B IQ’s and of 
ACE Scores with GPA in the Four Studies 








GPA, W-BIQ GPA, ACE Score 





Study v P FS Q.LfT 
Anderson [1] A oe Be 36 48 A9 
Student Clients* .58 .17 .46 27 .39 40 
Sartain [ 8] HO 186 S$ 35 A4 43 
Gerboth [3] oni a, SD as aay dll 





*All r’s significant above the 1% level. 


this sex difference does not appear in the W-B 
correlations with GPA. 

Table 3 gives the significance of the differ- 
ences between the correlations with GPA ob- 
tained in this study. In obtaining the ¢ ratios, 
r’s were transformed into Fisher’s z’s, a 
statistic whose sampling distribution is normal 
and independent of the magnitude of the uni- 
verse r. Since the correlations compared were 
all based on the same group, McNemar’s [4] 
procedure for estimating the standard error 
of the difference between z’s was employed. 
This technique takes into account the inter- 
correlations between the measures. 


Table 3 


Significance of the Differences between Correlations 
with GPA on the Student Client Group 











(N=—=248) 

Comparison £,—%, _ ae t 
FS vs. T +-.073 .061 1.20 
V vs. FS +.166 045 3.69* 
V vs. T +.239 .062 3.85* 
V vs. L +.251 .067 3.75* 
V vs.Q +.386 .069 5.59* 
V vs. P +.491 .071 6.92* 
P vs. FS — .325 041 7.97* 
P vs. T — .252 .070 3.60* 
P vs. L — .240 075 3.20* 
P vs.Q —.105 .070 1.50 
L vs.Q +-.135 .067 2.01 
T vs.Q +.147 044 3.34" 





*Significant above the 1% level. 


The results suggest that the time required 
to give the Verbal Scale is time well spent. 
This scale tends to predict college achievement 
better than does the ACE and these predic- 
tions do not appear to be affected by sex dif- 
ferences. In addition the scale provides the 
counselor with the opportunity to observe the 
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quality of a student’s behavior. Such observa- 
tions are often as useful in counseling as are 
quantitative scores. One can speculate that 
academic predictions based on the Verbal 
Scale are best because it reflects, like GPA, 
both personality and ability factors. 

The results also emphasize the need to 
interpret test scores in a very conservative 
manner and the need to utilize data from more 
than one source in making predictions about 
general college achievement. For the highest 
correlation reported, .58 between the Verbal 
Scale and GPA, the coefficient of alienation 
is .81. Predictions based on a correlation of 
this magnitude are only 19% better than 
chance. Further, it should be noted that most 
correlations obtained between college GPA’s 
and tests of ability have even less predictive 
power, particularly when predictions are made 
beyond the freshman level. 

Table 4 presents the intercorrelations be- 
tween W-B and ACE scores found in the four 
studies. Here there is more variability in the 
results, particularly with those involving the 
Performance Scale. The most noteworthy 
finding is that, in all four studies, the Verbal 
Scale predicts the various ACE scores as ade- 
quately as does the W-B Full Scale. In most 
of the comparisons the Performance Scale 
predicts ACE performance less well than does 


Table 4 
Comparisons of Intercorrelations of the W-B IQ’s 
and ACE Scores in the Four Studies 











Ander- Student Sar- Ger- 
Corre- son [1] Clients* tain [8] both [3] 
lations (¥=112) (N=251) (N=50) (N=?) 
V,Q -49 -50 -50 _ 
V.L 51 54 72 _ 
V.T 54 61 .68 57 
V.P 34 43 -53 — 
V.FS — 81 87 -- 
P,Q 31 42 -50 — 
P,L 19 85 54 —_ 
P,T -25 43 -55 _ 
P,FS — 80 84 — 
FS,Q — 55 -55 om» 
Fs,L - 54 -71 ae 
FS,T 48 61 69 58 
QL 61 49 60 _— 
QT — -79 -79 — 
L,T — 91 94 — 





*All r’s significant above the 1% level. 


the Verbal Scale. Table 5 shows the signifi- 
cance of the differences between the inter- 
correlations between W-B and ACE scores 
found in this study. 


Table 5 
Significance of the Differences between Intercorrela- 
tions between W-B IQ’s and Local ACE Cen- 
tiles for the Student Client Group 











(N=251) 

Comparison S,—-, a t 
V,Q vs. FS,Q —.069 .045 1.53 
VL vs. FS,L .00 —- — 
V,T vs. FS,T .00 — — 
V,Q vs. V,L —.055 .071 0.77 
V,Q vs. V,T —.160 .048 3.33* 
V.L vs. V,T —.105 .039 2.69* 
P,L vs. V,L — 238 071 3.35° 
P,T vs. V,T — .249 .075 3.32* 
P.O vs. V,Q —.101 .073 1.38 
P,Q vs. P,L +-.082 .068 1.21 
V,L vs. Q,L + .068 .082 0.83 
V,P vs. Q,L — .076 081 0.93 








*Significant above the 1% level. 


These intercorrelations are too low to sup- 
port the assumption that, in normal persons, 
performance level on various kinds of ability 
tests should be highly similar. They are too 
high to support the assumption occasionally 
implied in test interpretation that the different 
scales of the two tests measure discrete abil- 
ities. 


Summary 


Correlations between college freshmen 
GPA’s and the various W-B and ACE scales 
are reported. The findings of Anderson, Sar- 
tain, and Gerboth are reviewed and compared 
with the results found on 248 male student 
counseling center clients. Similar comparisons 
are made relative to the intercorrelations be- 
tween the W-B and the ACE scales. 

The L Scale of the ACE predicts the gener- 
al academic achievement of college freshmen 
as well as the Total ACE and better than the 
Q Scale. Correlations between ACE scores 
and grades are higher for women than for 
men; this trend is not apparent on the W-B. 
The Verbal Scale of the W-B appears to be 
the best single predictor of the general aca- 
demic achievement of freshmen. It also predicts 


the Q, L, and Total Scales of the ACE as ade- 
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quately as does the Full Scale of the W-B and 
predicts the L Scale about as adequately as 
does the Q Scale. The Performance Scale is 
least related to both academic achievement and 
the various ACE scales. It is possible that the 
reduced correlation between the Verbal and 
Performance Scales is due not only to the re- 
stricted range of talent in the college samples 
but also to the fact that, at this level of ability, 
the two scales do not measure similar factors. 
The data definitely support the use of the 
W-B as a predictor of the academic achieve- 
ment of freshmen. This test, especially its Ver- 
bal Scale, predicts as well as the ACE, a test 
specifically designed to predict the academic 
achievement of college freshmen. 

However, all of the obtained correlations 
are of such a magnitude that predictions re- 
garding an individual student’s academic 
achievement in freshmen college courses are 
subject to considerable error. Though data 
such as found in this study are a valuable aid 
in student counseling, one does well to note 
the variance that is unaccounted for in such 
results. Thus we believe that test scores are 
only part of the data that must be considered 
by a qualified counselor in helping students 
make decisions related to college achievement. 


Received June 11, 1952 
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The Effect of Variations in Ambiguity on Pro- 
jection in the Children’s Apperception Test” 


Edith A. Weisskopf-Joelson and David B. Lynn 


Purdue University 


How the degree of ambiguity of projective 
pictures affects the amount of projective ma- 
terial elicited by these pictures is a question 
which concerns the clinical practitioner as well 
as the theoretician. The former might be helped 
in the selection of effective pictures for projec- 
tive techniques if he had the answer to this 
question. The latter might profit from gaining 
insight into the relationship between two im- 
portant variables, namely, projection and am- 
biguity of the stimulus. 


It is generally assumed that projection in- 
creases with increasing ambiguity. Experi- 
mental studies appear to corroborate this im- 
pression [1, 3, 4, 5, 6, 8, 10, 11, 15] with few 
exceptions [7, 13, 14, 16]. One of the excep- 
tions is a study by Weisskopf [16], in which 
the ambiguity of TAT pictures was increased 
by two methods: (a) by incomplete tracing of 
the contours of the pictures, (4) by short ex- 
posure of the pictures. In both cases it was 
found that the more ambiguous pictures 
elicited less projection than the less ambiguous 
ones, when college students are used as sub- 
jects. 

The present study attempts to test the valid- 
ity of the above results for a different group 
of subjects, namely, for children. 


Subjects and Materials 


The subjects were 50 children, ranging in 
age from nine years to nine years and eleven 
months. All subjects attended the fourth grade 


1The paper is based on a thesis presented to the 
Graduate School of Purdue University, Lafayette, 
Indiana by the junior author in partial fulfillment 
of the requirements for an M.S. degree in psychol- 
ogy. The study was directed by the senior author. 
2This study was reported at the annual meeting 


of the Midwestern Psychological Association, De- 
troit, 1950. 
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of the same public school. Their 1Q’s on the 
Revised Stanford Binet Intelligence Scale, 
Form L, ranged from 83 to 154, with a mean 
of 116 and a standard deviation of 15.57. 

Ten pictures were selected from Bellak’s 
Children’s Apperception Test (CAT) [2]. 
These pictures were reproduced by incomplete 
tracing of the contours, i. e., part of the con- 
tours were omitted in order to increase the am- 
biguity. Figure 1 shows Picture 6 of the CAT 
incompletely traced. The pictures used for 
control purposes were modifications of the 
same ten pictures of the CAT. They were ob- 


A= 


Fig. 1. Picture 6, incompletely traced. 





——_ ad 


Fig. 2. Picture, 6, completely traced. 
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tained by completely tracing the contours of 
the pictures, as illustrated in Figure 2. Thus, 
the material consisted of an experimental set of 
ten incompletely traced pictures and a control 
set of the corresponding ten completely traced 
pictures. 

Procedure 


The pictures were administered individually 
to each subject. The experiment was con- 
ducted in two sessions with a two-week inter- 
val between sessions. The incomplete pictures 
were administered in the first session and the 
complete ones in the second session. The order 
was never reversed because it can be expected 
that previous exposure of the complete pic- 
tures might decrease the ambiguity of the in- 
complete ones. However, it is reasonable to 
assume that the effect of repetition did not 
affect the results, since a previous unpublished 
study by Weisskopf shows that mere repetition 
of administration does not alter the transcend- 
ence index of incomplete pictures. 

The instructions requested that the children 
“tell all about the picture.” These instructions 
were used rather than the ones suggested by 
Bellak [2] in order to keep the procedure as 
similar as possible to the one followed by 
Weisskopf [17], who used the instructions 
“describe the picture.”” However, when using 
children as subjects, it was found advisable to 
change this latter phrase to one which has a 
similar meaning but is easier understood by 
children. 

The amount of projection elicited by the 
pictures was measured by transcendence in- 
dices, a measure discussed in previous studies 
[16, 17, 18]. 

The transcendence index of a picture is ob- 
tained as follows: the subjects are asked to 
describe the picture. 


Even when the instructions call for objective 
description and not for fantasy, most subjects find 
it difficult to remain entirely descriptive. They tend 
to add projective material to their descriptions. In 
order to obtain the transcendence index of a pic- 
ture, the number of comments about this picture 
which go beyond pure description were counted. 
The transcendence index of the picture is the mean 
number of such comments per subject. Pictures with 
low transcendence indices make it relatively easy 
for subjects to be factual and impersonal. Pictures 
with high transcendence indices make such imper- 
sonal observation difficult and, as it were, “lure” 


the subjects away from the objective path pre- 
scribed by the instructions and “force” him to pro- 
ject [17, p. 379]. 


The deviations from objective description 
were scored in terms of various categories 
such as the following: 


Intraception refers to the ascribing of emotions, 
desires, thoughts, fantasies, etc., to figures in the 
picture. ... Temporal Transcendence refers to the 
inclusion of events which occur prior to, or after 
the event shown on the picture. . . . Relationship 
refers to the characterization of figures as related 
to other figures in the same picture. The great ma- 
jority of relationship scores refer to kinship, as 
when one figure is described as the father, mother, 
son, daughter, husband, wife, etc., of another fig- 
ure... . Content of speech refers to verbal state- 
ments made by pictorial figures. . . . Atmosphere 
refers to the characterization of the whole picture 
or parts of the picture in terms of the emotional 
response which it elicits in the observer. . . . Im- 
perative refers to comments to the effect that a 
pictorial figure “should,” “must,” “is supposed to,” 
act, feel, or think in a certain manner [17, p. 382- 
383]. 


The interjudge reliability, and the test-re- 
test reliability of transcendence scoring have 
been previously discussed [18]. 

The score-rescore reliability of the junior 
author was found to be .98 for the complete 
pictures as well as for the incomplete ones. 

The junior author and two additional 
judges scored the entire story material. Thus, 
each judge obtained a transcendence index for 
each picture. The mean of these three indices 
was used as the final transcendence index of 
the picture. The estimated reliability of this 
mean was found to be .96 for the complete 
pictures and .73 for the incomplete pictures 
[12]. The interjudge reliabilities of three 
judges ranged from .86 to .94 for the complete 
pictures and from .44 to .90 for the incom- 
plete pictures. 


Results 


The mean transcendence index for the in- 
complete pictures is .60, for the complete 
pictures, 1.48. The difference between the two 
means is statistically significant well beyond 
the 1 per cent level. An individual comparison 
of each incomplete picture with the corres- 
ponding complete picture yields a difference in 
the same direction for eight out of ten pic- 
tures. Seven of these eight differences are sig- 
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nificant beyond the 1 per cent level, while one 
is significant between the 1 and 2 per cent 
level. 
Discussion 

The results of this study are in agreement 
with those of the above-mentioned study by 
Weisskopf, which investigates the same prob- 
lem, using adults as subjects. “It seems that 
the subjects, when confronted with an indefi- 
nite and highly equivocal stimulus, produce 
less fantasy material than if confronted with 
a more definite picture” [16, p. 412-3]. The 
results of both studies are in agreement with 
Sears’s [14] findings pertaining to doll play. 

The implications of the results for the 
development of pictorial projective techniques 
have been presented in the earlier study: 


Can the results of this . . . study help the origi- 
nators of pictorial projective tests to select pictures 
of high diagnostic value? The author believes that 
the answer is in the affirmative. . . 

Are highly ambiguous or are highly structured 
pictures of greater diagnostic value? By increasing 
the degree of ambiguity of a picture . . . [by in- 
complete tracing], the production of fantasy ma- 
terial going beyond perception, such as the ascrib- 
ing of emotions to human figures, or the imagina- 
tive creation of past and future events, is de- 
creased. . . . Such a decrease would be a loss for 
diagnostic purposes, because transcendent material 
of this kind can be used as a basis for clinical di- 
agnosis. However, this loss is probably accom- 
panied by a gain in another direction. Even though 
highly ambiguous pictures do not elicit as much 
material bzyond perception, they may enable the 
clinician to make diagnostic use of perception it- 
self, that is, of what and how the subject per- 
ceives. With relatively ambiguous, unstructured 
pictures interpretation of this latter type may be 
more fruitful than with relatively definite pictures. 
High ambiguity of pictures increases the relative 
influence of individual differences on perception, 
as the protocols of the present study show. 

Thus, by using such relatively structured ma- 
terial as the . . . pictures [of the Childrens Apper- 
ception Test], the clinician loses diagnostic material 
of one kind and gains diagnostic material of an- 
other kind. He loses the possibility of basing his in- 
terpretation mainly on what the subjcct sees in the 
picture, since most nonpsychotic subjects show con- 
siderable agreement as to what is actually shown. 
But he gains diagnostic material consisting of addi- 
tions to perception, such as the imaginative creation 
of past and future events, or the ascribing of emo- 
tions and thoughts to human figures. In the Ror- 
schach, material of this kind is rarely produced. Ac- 
cording to the results of this study this comparative 


lack of transcendence in the Rorschach may be due 
to the fact that the Rorschach blots are so much 
more ambiguous than the pictures [of the 
Children’s Apperception Test]. “Rorschach inter- 
pretation . . . is based much more on what and 
how the subject perceives than what he adds to 
perception” [17, p. 380]. It “is based on transcend- 
ence of sensation rather than transcendence of per- 
ception” [17, pp. 380-381]. 

It seems that in whatever direction the ambiguity 
of projective stimuli is varied, diagnostic material 
of one kind is lost and of another is gained... . 
Thus, the present study claims a decrease with in- 
creased ambiguity for one kind of projection 
(transcendence) only. The study of the factors 
causing the negative relationship between trans- 
cendence and ambiguity may be a fruitful objec- 
tive for further research [16, pp. 414-415]. 


Summary 


The amount of projection elicited by pic- 
tures was studied as a function of the ambi- 
guity of the pictures. 

The subjects were 50 nine-year-old children. 
Ten pictures from the Children’s Appercep- 
tion Test by Bellak were traced, whereby parts 
of the contours were omitted to increase the 
ambiguity. The amount of projection elicited 
by these pictures was compared with the 
amount of projection elicited by fully traced, 
and thus less ambiguous pictures .The pictures 
with higher ambiguity elicited less projection 
than the less ambiguous pictures. This differ- 
ence was shown to be significant well beyond 
the 1 per cent level. 


Received June 25, 1952. 
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Sex Sequence in the Draw-a-Person Test and its 
Relation to the MMPI Masculinity- 
Femininity Scale 


Samuel Granick 
Washington, D. C. 


and Leon J. Smith 


St. Petersburg, Florida 


Subjects are expected to draw a figure of 
their own sex as their first response to the 
examiner’s direction to “draw a person” [2, 
5, 6]. Levy [5] reports that of 5000 adults 
examined, 87 per cent drew their own sex. A 
study of 80 college students, ranging in age 
from 18 to 58 years with a median of 26, 
showed similar results, 76 per cent of the sub- 
jects drawing their own sex as their initial re- 
sponse [3]. With reference to children be- 
tween the ages of 5 and 12 years, Jolles [4] 
found that both the boys and the girls drew 
their own sex predominantly when taking the 
H-T-P Test. Data obtained from 2 group of 
Serbian refugee children [1], on the other 
hand, indicated that while boys showed a pre- 
ference for drawing males, girls under 10 
tended to draw their opposite sex predom- 
inantly. The girls of 11 and 12 years of age, 
however, showed a preference for their own 
sex. How adolescents tend to respond has not 
as yet, to the authors’ knowledge, been re- 
ported in the literature. 

What the drawing of the same or opposite 
sex as the first response to the Draw-a-Person 
test implies clinically for an individual and 
generally for various age and sex groups 
appears never to have been systematically ex- 
plored. Machover [6] and Buck [2] empha- 
size that in drawing the human figure an in- 
dividual is probably making some kind of 
portrait of himself. In Machover’s words, 
“The process of drawing the human figure 
is for the subject, whether he realizes it or 
not, a problem not only in graphic skill, but 
one of projecting himself in all of the body 


71 


meanings and attitudes that have come to be 
represented in his body image.” She goes on 
to mention that empirically she has found 
“evidence of some degree of sexual inver- 
sion... in records of all individuals who drew 
the opposite sex first” [6, pp. 101, 102]. 

The study herein reported is not intended 
as a test of Machover’s entire hypothesis. In- 
deed that would be exceedingly difficult to 
accomplish since defining “some degree of 
sexual inversion” might prove elusive. In- 
tended, however, is an investigation of the 
incidence of self-sex drawings as the initial 
response to the Draw-A-Person test on the 
part of a group of adolescents and a compari- 
son of this with results obtained on a standard 
masculinity-femininity scale. 


Method 


The subjects for the experiment consisted of 
185 male and 386 female students in the 
general psychology course during the fall 
semester of 1950-51 at the Florida State Uni- 
versity. Since almost all students at the univer- 
sity tend to enroll in this course during their 
undergraduate years, this sample is probably 
representative, in terms of intelligence and 
cultural background, of the more than 6000 
students who were enrolled at the school dur- 
ing that period and who, in turn, were mainly 
from the various sections of the state of Flor- 
ida. The ages of the subjects were not record- 
ed, but since almost all the students were in 
their sophomore year, it is probably safe to 
assume that few were above 22 or below 17 
years of age. The vast majority ranged in age 
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between 18 and 20 years. 


A booklet of four pages was prepared, two of 
the pages to be used for the drawings and the other 
two containing the 60 questions or statements of 
the Minnesota Multiphasic Personality Inventory 
Masculinity-Femininity Scale to which answers of 
“true” or “false” were to be given. The tests were 
administered by the junior author to the subjects 
in 16 groups of approximately 40 students each. 
When each subject had a booklet, the group was 
instructed as follows. “On the front page you are 
to draw a person. I am not interested in your abil- 
ity to draw, but rather in how you attempt to draw 
a person. Please do not turn the pages of the book- 
let until told to do so.” When all subjects bad com- 
pleted the first drawing, they were further in- 
structed as follows. “Now turn to the next page. 
On this sheet you are to draw a person of the op- 
posite sex to the one you have just drawn. If you 
drew a male on the front page, draw a female 
here. If you drew a female, now draw a male.” 
When this drawing had been accomplished, the fol- 
lowing directions were given in the administration 
of the M-F Scale of the MMPI. “Please place the 
letter M for ‘male’ or the letter F for ‘female’ in 
accordance with your sex in the space provided at 
the top left-hand corner of the third page. Now 
circle T for ‘true’ and the letter F for ‘false’ ro 
these statements as they apply to you.” Invariably 
students questioned whether or not they should ap- 
pend their names to the booklets. They were told it 
was not necessary to do so unless they wished to. 
Mention was also made that their responses would 
in no way affect their grades in the course. 


Results 


Of the 185 males, 163 or 88.1 per.cent drew 
their own sex first. Similarly, the majority of 
the female subjects drew their own sex first 
(252 or 65.3 per cent of 386), but the pro- 
portion was significantly lower (CR=6.7, 
giving a p which is less than .01). The SE’s of 
the percentages were relatively low in each 
case (2.40 for the males and 2.42 for the 
females), thus indicating that the occurrence 
of the self-sex drawings for both groups was 
beyond chance expectation. These results agree 
fairly closely with Holtzman’s report [3] 
showing that 85 per cent of the males (N= 


Table 1 
MMPI M-F Scale Scores for Subjects 








Subjects N Mean SD t p 





Males 185 26.30 4.02 
29.6 <.001 
Females 386 37.26 4.50 





40) and 67.5 per cent of the females (N=40) 
drew their own sex as their first responses to 
the Draw-a-Person test. Generally, therefore, 
the sex sequence of the human-figure drawings 
differentiated the sexes on a group basis. 

The results of the MMPI M-F Scale were 
found also to separate the two sex groups as 
shown in Table 1. 

It should be noted, furthermore, that rela- 
tively little overlapping occurred between the 
distributions of the two sets of scores. 


Table 2 


Sex Sequence in the Draw-a-Person Test and 
MMPI M.-F Scale Scores 











g 
| 3 | 
ce ; eo 
2 FEE s § a » g 
rd Om f fx os fe fa, 
=~ | ‘ ' - ' m1 
$s i aa oe) me ee ee 
Males 163 26.30 4.22 22 26.22 5.10 .07 


Females 252 37.64 4.16 134 36.67 4.90 .18 





The question now arises as to what relation- 
ship, if any, may exist between the incidence 
of self-sex drawings as a first response to the 
Draw-a-Person test and the ratings achieved 
on the M-F Scale. Calculation of the point 
biserial correlations for both sexes indicated 
that this relationship is probably of a zero 
order (rp»i==.009 for males and r,.:=.105 for 
females). A comparison of the M-F Scale 
means of the subjects of each sex who drew 
the same sex first with the means of those who 
drew the opposite sex first, as shown in Table 
2, further substantiated this. In addition, the 
differences between the mean M-F Scale scores 
of those drawing either of the sexes first were 
in the direction of the sex of the subjects 
rather than of the sex drawn first. Thus a 
comparison of the scores of the males and fe- 
males drawing the male figure first yielded a ¢ 
of 19.9, showing a highly significant difference 
between the M-F Scale means. Similarly a ¢ of 
10.2 was obtained from the comparison of the 
M-F Scale scores of those subjects in both sex 
groups who drew the female figure first. 
Finally, a ¢ of 8.9 was found between the M-F 
Scale scores of both sexes for those drawing 
the opposite sex figure first. 
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Discussion 


Evident from the data is the fact that both 
the Draw-a-Person test and the MMPI M-F 
Scale serve to differentiate the male and female 
groups quite definitively. Apparently the tend- 
ency to draw the same sex first; however, is 
far stronger in men than in women. In these 
findings the present study is in essential agree- 
ment with results reported by other investi- 
gators. Added only is the fact that what is 
found among young children [4] and adults 
[3, 5] is also clearly the case with older 
adolescents attending college. 


Not so clear, on the other hand, is the sig- 
nificance of the self- or opposite-sex drawings 
as the initial response to the Draw-a-Person 
test. Insofar as the MMPI M-F Scale is a 
measure of psychosexual identification, the 
data would tend to refute the hypothesis of 
Machover [6] and Buck [2] suggesting that 
sexual inversion may be involved in the choice 
of the opposite sex as the first response to the 
request of the examiner to “draw a person.” 

Normal cultural factors are probably among 
the important determinants of the trend noted 
in this and other reports for people to draw 
their own sex predominantly on the Draw-a- 
Person test. Those subjects who fail to follow 
the trend may, of course, be responding to 
different cultural influences, or to a variety 
of internal stimuli, which lead to the associa- 
tion of opposite sex as their initial reaction. 
Empirically Machover [6] and Buck [2] have 
found reason to believe that one’s drawing of 
the human figure is essentially a self-portrait. 
But this may not be as generally true as they 
lead one to suppose. It is logical to suppose 
that the sex of the person one is inclined to 
draw as one’s first response to the Draw-a- 
Person test may be related to internal and ex- 
ternal stimuli far removed from psychosexual 
identification and self-portraiture. This is not 
to suggest, on the other hand, that in many 
instances conscious or unconscious portrayal of 
one’s body image is not involved. Evident, 
however, is the need to investigate the fan- 
tasies and environmental factors affecting an 
individual at the time he is responding to the 
Draw-a-Person test. 


Summary and Conclusions 


The Draw-a-Person test and the MMPI 
M-F Scale were administered to a group of 
185 male and 386 female college students 
taking the general psychology course. ‘The sex 
of the figure drawn as the first response was 
noted in each instance and compared, in turn, 
with the scores made on the masculinity- 
femininity test. An analysis of the data yielded 
the following conclusions. 


1. Male and female college undergraduates 
tended to draw their own sex predominantly 
when directed to “draw a person.” The inci- 
dence of same-sex drawings was significantly 
greater among males than among females. 


2. The MMPI M-F Scale significantly 
differentiated between the male and female 
subjects. 


3. No relationship was found between the 
sex sequence of human figures drawn and 
scores on the masculinity-femininity measure. 


Received June 4, 1952. 
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A Note on the “Tree and Trauma” Interpretation 
in the HTP’ 


Murray Levine and Eugene H. Galanter’ 


University of Pennsylvania and VA Mental Hygiene Clinic, Philadelphia 


In his manual Buck [1, p. 390] suggests 
that blemishes drawn on the tree, such as 
scars, knotholes, broken branches, points of 
unusual shading or reinforcement, or weak or 
dead branches, may be representative of trau- 
mata which have occurred in the life of the 
person making the drawing. Furthermore 
he suggests [1, p. 340] that the ratio between 
the height of the traumatic indicator and the 
total height of the tree will yield the approx- 
imate age, plus or minus one year, of the oc- 
currence of the trauma. The suggested inter- 
pretation has practical import.ace in terms of 
diagnosis, and it also contains implications for 
the theory of projection in expressive tech- 
niques. Specifically it would mean that the tree 
drawing has some relationship to the self con- 
cept as the self concept is projected into a “life 
space.” It is then of considerable interest to 
treat the interpretative suggestion as an hy- 
pothesis and to attempt an objective verifica- 
tion of that hypothesis. 

The clinical evidence related to this sug- 
gestion is seemingly derived from the post hoc 
examination of the individual’s life history for 
incidents considered traumatic by the individ- 
ual. The interrogation of the subject involves 
suggesting the age of traumatic occurrence to 
him and his response is therefore not independ- 
ent of the indicator in the drawing. Further- 
more the criteria for a traumatic occurrence 
are not specified and any unusual occurrence 
mentioned by the subject is accepted as a valid 


tReviewed in the VA and published with the 
approval of the Chief Medical Director. The state- 
ments and conclusions published by the authors are 
the result of their own study and do not necessarily 
reflect the opinion or policy of the VA. 


2The authors wish to thank Dr. L. J. Hatterer of 
the Kingsbridge VA Hospital, New York, who was 
instrumental in helping to gather the reported data. 
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“trauma.” An objective test of the validity of 
the interpretation requires that both the trau- 
ma and its date of occurrence be specified in- 
dependently of the drawing. 


The writers obtained drawings of a tree 
from 27 hospitalized, paraplegic veterans as- 
suming that the severity of the injury and the 
circumstances under which it occurred, as well 
as the complete reorientation to life the injury 
requires, make it eligible as a trauma. In ad- 
dition one can specify the exact date of occur- 
rence of the trauma. Both the trauma and the 
time of occurrence are in this way specified 
independently of the drawing. The instructions 
were simply “Draw a tree.” The population 
ranged in age from 18 to 40, the median age 
being 26 years and the duration of injury 
ranging from 6 months to 10 years, with a 
median duration of 15 months. 


The presence of traumatic indicators on the 
tree was independently rated by the authors 
according to the general criteria stated by 
Buck. The raters agreed as to presence or ab- 
sence of indicators in 82 per cent of the cases. 
The degree of agreement is significantly great- 
er than chance agreement of 50 per cent. Of 
the 27 drawings rated, only 7 contained un- 
equivocal traumatic indicators. The fact that 
only a small percentage of this obviously trau- 
matized population drew indicators which could 
be reliably rated as such suggests that either 
the hypothesis has dubious validity, or that 
other unknown personality factors contribute 
to the appearance or nonappearance of such in- 
dicators on tree drawings. The age of occur- 
rence of the trauma was calculated in each of 
these 7 drawings and compared with the actu- 
al age of traumata as obtained from the pa- 
tient’s records. The correspondence was poor. 
None of the cases fell within the two-year 
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limit suggested by Buck. However, a rank- 
order correlation between the estimated age of 
occurrence obtained from the drawing and the 
actual age of occ. rence obtained from hospi- 
tal records proved to be plus .73; significant 
for the 7 cases at approximately the .05 level 
of confidence. In addition to the few cases, 
confidence in the size of this coefficient is 
lessened by the presence of split ranks. These 
results, however, suggest that the hypothesis 
may have some degree of validity in terms of 
a broad approximation of the time of injury, 
but statements concerning more exact localiza- 
tion in time are not supported by our data. 
Since only a small percentage of this trau- 
matized population spontaneously drew trau- 
matic indicators, future research will require 
dealing with a very much larger parent popu- 


lation in order to obtain sufficient cases to test 
the hypothesis adequately. Verification of the 
interpretation, even in the form suggested by 
the present results, would seem to have in- 
teresting theoretical consequences for the 
general concept of projection in expressive 
techniques, and specifically for the notion that 
the self concept can be studied by this and 
similar methods. Others who may be working 
with similarly traumatized individuals might 
profitably repeat the study with larger samp- 
les. 


Received June 6, 1952. 
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Ashby, W. Ross. Design for a brain. New York: 
John Wiley & Sons, 1952. Pp. ix + 260. $6.00. 


This is another excellent addition to the list of 
distinguished treatises on cerebral mechanisms that 
Wiley has been publishing. The problem that 
Ashby has set himself is “to deduce from the ob- 
served facts” what are the necessary properties of 
a nervous system that acts “at once mechanistically 
and adaptively.” The book is well written, the 
thesis clearly and tightly developed, and there is 
much more use of and integration with specific 
biological findings than one is apt to get in 
theoretical works of this sort. It remains, however, 
of necessity a difficult book which merits a larger 
audience than it will probably get. Its appeal will 
be greater to students of the logic of science and 
of system construction than it will be to practicing 
clinicians. The appendix contains a 50-page re- 
statement of the thesis in mathematical form.— 
W. A. Hz. 


Baumgarten, Franziska (Ed.) La psychotechnique 
dans le monde moderne. C. R. du IX® Congres 
International de Psychotechnique. Paris: Presses 
Universitaires de France, 1952. Pp. xi-+ 630. 
2,000 fr. 


This is the report of the 9th International 
Congress of Psychotechnology held in Berne, Swit- 
zerland, in 1949, fifteen years after the last pre- 
vious Congress. In addition to the welcoming ad- 
dresses, and a report by the General Secretary of 
the preceding fifteen years of the work of the In- 
ternational Association of Psychotechnology, the vol- 
ume includes over 100 papers presented by persons 
representing 23 different countries. More than half 
of the papers are in French, the others are in Ger- 
man, English, or Italian. These papers are present- 
ed under fourteen topical headings representing a 
wide array of problems and applications. Although 
containing but few detailed research reports, the 
volume offers an unusual opportunity to become ac- 
quainted with the current thinking and practice 
of our colleagues in other lands. Only seven of the 
papers were by Americans!—E. L, K. 





Note.—The reviews were prepared by the Editor 
and the Associate Editors, who may be identified 
by their initials. 
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U. S. Federal Security Agency. Public Health Serv- 
ice. National Institute of Mental Health. Mental 
health and motion pictures. Publ. Hith Serv. 
Publ. No. 218. Washington: U. S. Government 
Printing Office, 1952. Pp. 124. $.30. 


For anyone who has the responsibility of publi- 
cizing or training in the various aspects of mental 
health this guide to 106 films is a positive must. 
The films are grouped under Child and Family, 
Marriage, Mental Health and Schools( for teach- 
ers, and for students), Mental Health Problems, 
Physiology of Human Reproduction, and Miscel- 
laneous. The synopses clearly present the descrip- 
tion of the film, its aims, and other information 
pertinent to its use. The format is excellent, giving 
running time, distributor, television information, 
followed by ample space for personal comments by 
the local viewer. The “Suggested Audiences” con- 
tains valuable information. Care has been taken 
not only to state the audience for which the film 
was planned but also, in the case of films whose 
presentation needs more careful controls, the type 
of control needed such as the presence of a trained 
professional worker. The book contains a list of 
agencies designated as State Mental Health Au- 
thorities, names and addresses of distributors, and 
an excellent index———B. M. L. 


Frosch, John. (Ed.) The annual survey of psycho- 
analysis. Vol. I, 1950. New York: International 
Universities Press, 1952. Pp. xvi + 556. $10.00. 


“This is the psychoanalytic literature of 1950, all 
of it.... ” With this opening statement, a new 
survey venture in psychoanalytic literature was 
launched. Apparently other annual surveys are to 
follow. The publication aims at abstracting all the 
periodical literature of the field and many of the 
books for a given year; it does not aim at critical 
reviews. Eleven of the twelve chapters deal syste- 
matically with articles in the field, while the last 
chapter abstracts 12 of the 42 books published 
during the year 1950. Some idea of the subject or- 
ganization can be gained from several chapter ti- 
tles: History, Methodology, Clinical Studies, Child 
Analysis, Psychoanalytic Therapy, Applied Psycho- 
analysis, etc. Many contributors are listed as ab- 
stractors, and most of the chapters have different 
authors. The job done in this survey is tremendous, 
but even more important is the quality of most of 
the abstracts. Comparing the abstracts with some 
of the complete articles creates great respect for the 
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compilers of this publication. Not infrequently is 
an article improved in readability and clarity by 
the abbreviation; writers in the psychoanalytic field 
are not as a rule adherents of the Law of Parsi- 
mony. The Annual Survey of Psychoanalysis is a 
welcome addition to psychological and psychiatric 
literature. Psychoanalysis will probably win more 
friends and more understanding through this vol- 
ume than through the original material it attempts 
to abstract—M. K. 


Hirsh, Ira J. The measurement of hearing. New 
York: McGraw-Hill, 1952. Pp. ix + 364. $6.00. 


The fields of experimental psychology and clinical 
audiometry are nicely integrated in this comprehen- 
sive and useful book on hearing. The introductory 
chapters give enough background on psychophysics, 
the physics of sound, and electroacoustic devices to 
serve the needs of readers who have at least a mini- 
mum acquaintance with the physiology and psy- 
chology of audition. The major problems taken up 
in the remaining chapters include the measurement 
of the hearing of pure tones and of speech, masking, 
fatigue, differential sensitivity, binaural hearing, 
bone conduction, and the use of conditioned re- 
sponse methods in audiometry. Because hearing loss 
is often related to a person’s broader social adjust- 
ments, clinical psychologists have good reason to 
maintain more than a casual acquaintance with 
audiometry. They will find Hirsh’s book an excel- 
lent resource.—L. F. S. 


Kornitzer, Margaret. Child adoption in the mod- 
ern world. New York: Philosophical Library, 
1952. Pp. xiii + 403. $4.50. 


The greater part of this book, written by the press 
officer of a group of British adoption societies, con- 
cerns present practices with detailed description of 
legal procedures in Great Britain. There is also 
some routine discussion of adoption problems gen- 
erally, selection of adoptive parents, telling the 
child, the unadoptable child, and so on. Adoption 
first became legal in Great Britain in 1926; in 1949, 
seventeen thousand adoption orders were made. 
About one-third of the book discusses adoptive prac- 
tices in other parts of the British Commonwealth, 
and brief reference is made to the situation in other 
countries. Two chapters are devoted to the United 
States. These summarize the legal situation in the 
various states and give some over-all comparison 
with that in Great Britain, but contain chiefly a 
“mosaic of brief quotations . . . because only in 
this way is it possible for a British writer to pre- 
sent, primarily for British readers and without 
causing offence to American ones anything like a 
valid picture of what goes on in the American 
adoption field today.”—A. R. 


Kuhlen, Raymond G., & Thompson, George G. 
(Eds.) Psychological studies of human develop- 


ment. New York: Appleton-Century-Crofts, 1952. 
Pp. xiii + 532. $3.50. 


Currently, source books for introductory courses 
in psychology are finding their way into the class- 
room in increasing numbers. This paper-bound vol- 
ume is a collection of 71 abridged and edited pri- 
mary source materials in the general area of devel- 
opmental psychology—here defined as extending 
from infancy through senescence. The subject mat- 
ter covered includes physical factors in develop- 
ment, learning, intellectual development, social-cul- 
tural conditions, interest patterns, vocational orien- 
tation, and personal-emotional adjustment. The pa- 
pers, originally published between 1928 and 1951, 
represent not only different research areas, but dif- 
ferent methodologies, with the result that the stud- 
ies selected will be considered of uneven quality by 
many readers. Although many studies now consid- 
ered “classics” are included (e.g., Gesell, Jones & 
Conrad, Terman, Hartshorne & May, and Levy), it 
is inevitable that most readers will find some of 
their particular favorites missing. Although in gen- 
eral the abridgment and editing are done with care, 
it is questionable whether some of the more exten- 
sive abbreviations are wise (as, the reduction of 
Levy’s book, Maternal Overprotection, to eight 
pages). These problems intrinsic to source books, 
however, should not detract importantly from the 
usefulness of this volume as a teaching aid in intro- 
ductory courses in developmental psychology.—A. M. 


Wolfie, Dael. (Chairman) Improving undergrad- 
uate instruction in psychology. New York: Mac- 
millan Company, 1952. Pp. vii + 60. $1.25. 


This is a 60-page report of a study group which 
attacked the problems of the objectives and the 
curriculum of undergraduate instruction in psy- 
chology. The members of the committee are well 
known and respected by their colleagues and the 
report will carry weight. A recommended curricu- 
lum with core, special interest, advanced, and inte- 
grative courses is presented for the typical liberal 
arts undergraduate. It is frankly a psychology- or 
content-centered curriculum rather than a student- 
or problem-oriented one. The educational objectives 
of personal growth and social adjustment are con- 
sidered but rejected in favor of knowledge, habits 
of thought, and attitudes and values. The report 
states further that “it is probably desirable to 
avoid direct frontal efforts to modify student’s 
habits and attitudes.” Little spiace is given to indi- 
rect and student-centered means of dealing with 
attitudes and values that do not employ the meth- 
ods the committee rightly banned such as “pres- 
sure,” disregard for student rights, or reformation. 
Although a traditional and conservative education- 
al climate pervades the report, there is an occasion- 
al hint that in committee discussion the realities of 
student motivation, individual differences, and 
present societal needs occasionally arose. The pub- 








78 New Books 


lished report, however, does not seem to give much 
significance to these influential factors which will 
determine how well their educational objectives 
can be met. This report can render a real service 
if it provokes debate and research on both the po- 
tential role of psychology in a liberal education and 
the means by which this can be realistically ac- 
complished with our present student body. It will 
serve also as a target of attack for those who feel 
along with this reviewer that the psychologist has 
a special responsibility and competency adroitly to 
assist students to meet their personal and social 
needs, and who also maintain that this is a pri- 
mary educational goal and basic to a liberal educa- 
tion —F. McK. 


Tests 


Bennett, George K., Seashore, Harold G., & Wes- 
man, Alexander G. Differential Aptitude Tests. 
Manual (2nd Ed.), pp. 77 ($2.00). New York: 
Psychological Corp., 1952. 


The Differential Aptitude Tests have been pro- 
vided with an entirely new manual which replaces 
the original loose-leaf edition of 1947 and its five 
supplements issued between 1948 and 1951. In 
addition to the inevitable directions for administra- 
tion, scoring, and use, the new manual contains 
unusually comprehensive data about the tests. Norms 
are now based on groups of 2100 to 7400 for Form 
A, and of 350 to 1075 for Form B, for each sex and 
for each grade from 8 to 12, separately. The va- 
lidity of the DAT is described in terms of its pre- 
diction of subsequent course grades, achievement 
test scores, and postschool careers. There are about 
20 pages of tables of validity coefficients. Also pre- 
sented with more than minimum adequacy are re- 
liabilities, standard errors of measurement, and the 
intercorrelations of the tests. Even more detailed re- 
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search data have been deposited with the Ameri- 
can Documentation Institute so as to be available 
to technically trained users. The Manual can serve 
as model for other test constructors, and as an ad- 
junctive text for courses in measurement.—-L. F. S. 


Books Received 


Adler, Leta M., Coddington, James W., & Stewart, 
Donald D. Mental illness in Washington County, 
Arkansas: Incidence, recovery, and posthospital 
adjustment. Little Rock, Ark.: Univer. of Arkan- 
sas, 1952. Pp. 74. 


Brennan, Robert E. General psychology. (Rev. Ed.) 
New York: Macmillan, 1952. Pp. xxxii + 524. 
$5.50. 

Coombs, Clyde H. A theory of psychological scal- 
ing. Engng Res. Bull. No. 34. Ann Arbor, Mich.: 
Univer. of Michigan, 1952. Pp. vi + 94. $1.75. 

Eisler, Robert. Man into wolf, an anthropological 
interpretation of sadism, masochism, and lycan- 
thropy. New York: Philosophical Library, 1952. 
Pp. 286. $6.00. 

Lindner, Robert. Prescription for rebellion. New 
York: Rinehart, 1952. Pp. 305. $2.75. 

Maslow, Paul. Powers of the mind. Brooklyn, N. 
Y. (16 Court St.): Author, 1952. Pp. 288. $3.50. 

Meerloo, Joost A. M. Conversation and communi- 
cation, a psychological inquiry into language and 
human relations. New York: International Uni- 
versities Press, 1952. Pp. x + 245. $4.00. 

Palmer, Harold. The philosophy of psychiatry. New 
York: Philosophical Library, 1952. Pp. ix + 70. 
$2.75. 

Powys, John Cowper. The inmates. New York: 
Philosophical Library, 1952. Pp. 318. $4.50. 

Helping parents understand the exceptional child. 
Proc. Annu. Conf. Educ. Except. Child. Lang- 
horne, Pa.: The Woods Schools, 1952. Pp. 42. 
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4 Distinctive McGRA - HILL Books 





PSYCHOANALYTIC THEORIES 


By Geratp 8. BLUM, University of Michiga 
ogy. In press 


This new text seeks to present descriptive yet 
opinions on personality development, organized a: 
factual and objective. In addition to the consi: 
includes a section of “Notes” at the end of ea: 
existing experimental data, suggested evidence 
comaparisons of overlapping views. 





THE PSYCHOLOGY OF INDI 


By C. H. Lawsue, Purdue University. In 


Presented in an unusual, non-technical, and ; 
psychologists and even those who have ncve 
psychology offers. Aimed specifically at supe: 
useful to the college student studying managen 





PRATICAL PSYCHOLOGY. N 
By Karu S. Bexrnnarpt, University of To: 


Designed for students who are doing werk at a | 
vides @ sound treatment of psychology, using 
with down-to-carth applications, Practical P: 
introductory psychology, but adds chapters o 
adjustment. A chapter on aptitude measurem¢ 
efficiency have iveen added. 





THE MEASUREMENT OF Hi! 


By Ina J. Hinsu, Washington University and 
Hill Publications in Psychology. 364 pages 


A text for clinical otologists, experimental psy: 
eers, and others who do experimenta! work or 
mental information about acoustics, electroac 
and applies this information to the severa! fa 





Send for copies on 





OF PERSONALITY 


iraso-Htill Publications in Psychol- 


.ccounis of expert psychoanalytical 
ng to age levels. The exposition is 
on of leading opinions, the author 
ipter which offer brief resumés of 
related fields, imconsistencies, and 


RIAL RELATIONS 


nanner, this book shows the nori- 
1 psychology the things industrial 
id managers in industry, it also is 


2nd Edition 
7 pages, $3.75 


econdary school level, this text pro- 
tical approach. Simple in treatmen:, 
covers most of the usual topics in 
1ining, mental hygiene and personal 
another on personal happiness and 


LING 


ral Tustitute for the Deaf. McGraw- 


acmistics or communications engin- 
og. It brings together basic, experi- 


ipment, psychology of hearing, etc., 
the measurement of hearing. 
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